Sep 03 11:45:33 devstack cinder-volume[76289]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 11:45:33 devstack cinder-volume[76289]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:45:33 devstack cinder-volume[76289]: we strongly recommend against using it for new projects. Sep 03 11:45:33 devstack cinder-volume[76289]: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:45:33 devstack cinder-volume[76289]: framework. For more detail see Sep 03 11:45:33 devstack cinder-volume[76289]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:45:33 devstack cinder-volume[76289]: import eventlet # noqa Sep 03 11:45:35 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:45:35 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:45:35 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:45:36 devstack cinder-volume[76289]: INFO dbcounter [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Registered counter for database cinder Sep 03 11:45:36 devstack cinder-volume[76289]: DEBUG oslo_db.sqlalchemy.engines [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:45:37 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writer thread running {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:45:37 devstack cinder-volume[76289]: INFO cinder.rpc [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 11:45:37 devstack cinder-volume[76289]: INFO cinder.rpc [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 11:45:37 devstack cinder-volume[76289]: DEBUG oslo_db.sqlalchemy.engines [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:45:37 devstack cinder-volume[76289]: INFO cinder.volume.manager [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Determined volume DB was empty at startup. Sep 03 11:45:37 devstack cinder-volume[76289]: DEBUG cinder.volume.manager [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76289) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 11:45:37 devstack cinder-volume[76289]: INFO cinder.volume.manager [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 11:45:37 devstack cinder-volume[76289]: WARNING stevedore.named [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:45:37 devstack cinder-volume[76289]: WARNING castellan.key_manager [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:45:37 devstack cinder-volume[76289]: WARNING cinder.keymgr.conf_key_mgr [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:45:37 devstack cinder-volume[76289]: DEBUG cinder.volume.drivers.lvm [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76289) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Sep 03 11:45:37 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:37 devstack cinder-volume[76289]: DEBUG oslo_concurrency.processutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] CMD "cinder-rtstool verify" returned: 0 in 0.430s {{(pid=76289) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:37 devstack cinder-volume[76289]: DEBUG oslo_db.sqlalchemy.engines [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:45:37 devstack cinder-volume[76289]: INFO cinder.rpc [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Sep 03 11:45:37 devstack cinder-volume[76289]: INFO cinder.rpc [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Sep 03 11:45:37 devstack cinder-volume[76289]: WARNING stevedore.named [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:45:37 devstack cinder-volume[76289]: WARNING castellan.key_manager [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:45:37 devstack cinder-volume[76289]: INFO cinder.volume.manager [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Image-volume cache enabled for host devstack@lvmdriver-1. Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_db.sqlalchemy.engines [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76289) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:45:38 devstack cinder-volume[76289]: INFO oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Starting 1 workers Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Started child 76456 {{(pid=76289) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Full set of CONF: {{(pid=76289) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] ******************************************************************************** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Configuration options gathered from: {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] ================================================================================ {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] allow_availability_zone_fallback = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] allow_compression_on_image_upload = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] allowed_direct_url_schemes = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76456]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] api_rate_limit = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] auth_strategy = keystone {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] az_cache_duration = 3600 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_availability_zone = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_host = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_stats_polling_interval = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backup_api_class = cinder.backup.api.API {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backup_name_template = backup-%s {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backup_use_same_host = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backup_use_temp_snapshot = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] chap_password = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] chap_username = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_internal_tenant_project_id = 885d68b99d33449fa05223534a07602f {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_internal_tenant_user_id = 4ae2cc3a8cb74390ba0d6c5ef8d31fb9 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cloned_volume_same_az = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cluster = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] compression_format = gzip {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] compute_api_class = cinder.compute.nova.API {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] config_dir = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] config_source = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] control_exchange = openstack {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] debug = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] default_availability_zone = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] default_group_type = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] default_volume_type = lvmdriver-1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] disk_geometry = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] driver_client_cert = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] driver_client_cert_key = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] driver_data_namespace = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] driver_ssl_cert_path = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] driver_ssl_cert_verify = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] driver_use_ssl = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] enable_force_upload = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] enable_new_services = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] enable_unsupported_driver = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] enabled_backends = ['lvmdriver-1'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] enforce_multipath_for_image_xfer = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] filter_function = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_api_insecure = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_api_ssl_compression = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_ca_certificates_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_catalog_info = image:glance:publicURL {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_num_retries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance_request_timeout = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] goodness_function = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] graceful_shutdown_timeout = 5 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] group_api_class = cinder.group.api.API {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] host = devstack {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_compress_on_upload = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_conversion_address_space_limit = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_conversion_cpu_limit = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_conversion_disable = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_upload_use_cinder_backend = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_upload_use_internal_tenant = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_volume_cache_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_volume_cache_max_count = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] image_volume_cache_max_size_gb = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] init_host_max_objects_retrieval = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] instance_format = [instance: %(uuid)s] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] iscsi_target_flags = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] iscsi_write_cache = on {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] iser_helper = tgtadm {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] iser_ip_address = 192.168.122.215 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] iser_port = 3260 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_color = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_config_append = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_dir = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_options = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_rotate_interval = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_rotate_interval_type = days {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] log_rotation_type = none {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack sudo[76460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] max_age = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] max_logfile_count = 30 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] max_logfile_size_mb = 200 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack sudo[76460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:38 devstack cinder-volume[76456]: INFO cinder.volume.manager [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Starting volume driver LVMVolumeDriver (3.0.0) Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] max_over_subscription_ratio = 20.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] message_reap_interval = 86400 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] message_ttl = 2592000 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] migration_create_volume_timeout_secs = 300 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] monkey_patch = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] monkey_patch_modules = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] my_ip = 192.168.122.215 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] no_snapshot_gb_quota = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] num_iser_scan_tries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] num_shell_tries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] num_volume_device_scan_tries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] nvmeof_conn_info_version = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] nvmet_ns_id = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] nvmet_port_id = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] osapi_max_limit = 1000 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] osapi_volume_ext_list = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] osapi_volume_listen = 0.0.0.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] osapi_volume_listen_port = 8776 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] osapi_volume_use_ssl = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] osapi_volume_workers = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] per_volume_size_limit = -1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] periodic_fuzzy_delay = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] periodic_interval = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] project_id_regex = [0-9a-f\-]+ {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] public_endpoint = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] publish_errors = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] quota_backup_gigabytes = 1000 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] quota_backups = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] quota_gigabytes = 1000 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] quota_groups = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] quota_snapshots = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] quota_volumes = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] rate_limit_burst = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] rate_limit_except_level = CRITICAL {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] rate_limit_interval = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] reinit_driver_count = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] replication_device = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] report_discard_supported = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] report_interval = 120 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] reservation_clean_interval = 86400 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] reservation_expire = 86400 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] reserved_image_namespaces = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] reserved_percentage = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] rpc_response_timeout = 120 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] run_external_periodic_tasks = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] scst_target_driver = iscsi {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] scst_target_iqn_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_down_time = 720 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] shell_completion = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] snapshot_name_template = snapshot-%s {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] snapshot_same_host = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] split_loggers = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] state_path = /opt/stack/data/cinder {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] storage_availability_zone = nova {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] storage_protocol = iSCSI {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] syslog_log_facility = LOG_USER {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] target_helper = lioadm {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] target_ip_address = 192.168.122.215 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] target_port = 3260 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] target_protocol = iscsi {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] target_secondary_ip_addresses = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] trace_flags = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] transfer_api_class = cinder.transfer.api.API {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] transport_url = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] until_refresh = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] use_chap_auth = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] use_default_quota_class = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] use_journal = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] use_json = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] use_multipath_for_image_xfer = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] use_stderr = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] use_syslog = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] verify_glance_signatures = enabled {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_api_class = cinder.volume.api.API {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.035s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_backend_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_clear = zero {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_clear_ionice = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_clear_size = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_copy_bps_limit = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_dd_blocksize = 1M {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_name_template = volume-%s {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_service_inithost_offload = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volume_usage_audit_period = month {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] zoning_mode = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_concurrency.disable_process_locking = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] os_brick.lightos_discovery_client_address = localhost {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.auth_section = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.auth_type = password {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.auth_version = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.cache = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.delay_auth_decision = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.http_connect_timeout = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.include_service_catalog = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.insecure = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.interface = public {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_password = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcache_username = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.region_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.service_token_roles_required = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.service_type = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.token_cache_time = 300 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.backend = dogpile.cache.null {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.backend_argument = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.backend_expiration_time = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.config_prefix = cache.oslo {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.debug_cache_backend = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.enable_retry_client = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.enable_socket_keepalive = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.expiration_time = 600 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.hashclient_dead_timeout = 60.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.hashclient_retry_attempts = 2 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.hashclient_retry_timeout = 1.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.memcache_dead_retry = 300 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.memcache_pool_maxsize = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.memcache_sasl_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.memcache_servers = ['localhost:11211'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.password = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.proxies = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.redis_db = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.redis_sentinel_service_name = mymaster {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.redis_server = localhost:6379 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.retry_attempts = 2 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.retry_delay = 0.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.socket_keepalive_count = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.socket_keepalive_idle = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.socket_keepalive_interval = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.socket_timeout = 1.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.tls_allowed_ciphers = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.tls_cafile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.tls_certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.tls_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.tls_keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cache.username = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] coordination.backend_url = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.asyncio_connection = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.asyncio_slave_connection = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.backend = sqlalchemy {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.connection = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.connection_debug = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.connection_parameters = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.connection_recycle_time = 3600 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.connection_trace = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.db_inc_retry_interval = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.db_max_retries = 20 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.db_max_retry_interval = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.db_retry_interval = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.max_overflow = 50 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.max_pool_size = 5 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.max_retries = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.mysql_sql_mode = TRADITIONAL {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.mysql_wsrep_sync_wait = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.pool_timeout = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.retry_interval = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.slave_connection = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.sqlite_synchronous = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.synchronous_reader = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] database.use_db_reconnect = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_metrics.metrics_process_name = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_tracing.insecure = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.connection_string = messaging:// {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.es_doc_type = notification {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.es_scroll_size = 10000 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.es_scroll_time = 2m {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.filter_error_trace = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.hmac_keys = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.sentinel_service_name = mymaster {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.socket_timeout = 0.1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.trace_requests = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler.trace_sqlalchemy = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler_jaeger.process_tags = {} {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler_jaeger.service_name_prefix = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] profiler_otlp.service_name_prefix = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.enforce_new_defaults = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.policy_default_rule = default {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.policy_file = policy.yaml {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_policy.remote_timeout = 60.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] privsep_osbrick.capabilities = [21, 2] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] privsep_osbrick.group = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] privsep_osbrick.helper_command = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] privsep_osbrick.thread_pool_size = 4 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] privsep_osbrick.user = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_sys_admin.group = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_sys_admin.helper_command = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] cinder_sys_admin.user = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.auth_section = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.auth_type = password {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.cafile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.collect_timing = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.insecure = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.send_service_user_token = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.split_loggers = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.timeout = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.tls_ciphers = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] service_user.tls_min_version = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.auth_section = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.auth_type = password {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.collect_timing = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.insecure = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.region_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.split_loggers = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.timeout = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.tls_ciphers = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] glance.tls_min_version = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.backend_availability_zone = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.chap_password = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.chap_username = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.disk_geometry = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.driver_client_cert = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.driver_client_cert_key = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.driver_data_namespace = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.driver_use_ssl = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.enable_unsupported_driver = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.extra_capabilities = {} {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.filter_function = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.goodness_function = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.iscsi_target_flags = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.iscsi_write_cache = on {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.iser_helper = tgtadm {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.iser_port = 3260 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.lvm_mirrors = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.lvm_share_target = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.lvm_type = auto {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.num_shell_tries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.nvmet_ns_id = 10 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.nvmet_port_id = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.replication_device = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.report_discard_supported = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.reserved_percentage = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.scst_target_driver = iscsi {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.scst_target_iqn_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.storage_protocol = iSCSI {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.target_helper = tgtadm {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.target_port = 3260 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.target_protocol = iscsi {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.trace_flags = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.unique_fqdn_network = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.use_chap_auth = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_backend_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_clear = zero {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_clear_ionice = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_clear_size = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volume_group = cinder-volumes {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_reports.file_event_handler = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_reports.log_dir = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.backend_availability_zone = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.backend_host = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.chap_password = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.chap_username = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.chiscsi_conf = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.disk_geometry = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.driver_client_cert = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.driver_data_namespace = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.driver_use_ssl = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.extra_capabilities = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.filter_function = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.goodness_function = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.iscsi_write_cache = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.iser_helper = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.iser_ip_address = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.iser_port = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.iser_target_prefix = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.lvm_conf_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.lvm_mirrors = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.lvm_share_target = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.lvm_type = auto {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.num_shell_tries = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.nvmet_ns_id = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.nvmet_port_id = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.replication_device = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.report_discard_supported = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.reserved_percentage = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.scst_target_driver = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.storage_protocol = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.target_helper = lioadm {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.target_ip_address = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.target_port = 3260 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.target_protocol = iscsi {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.trace_flags = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.use_chap_auth = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_clear = zero {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_clear_size = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] lvmdriver-1.volumes_dir = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.ssl = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.ssl_version = {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_notifications.driver = [] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_notifications.retry = -1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] oslo_messaging_notifications.transport_url = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] key_manager.fixed_key = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.barbican_api_version = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.barbican_endpoint = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.barbican_endpoint_type = public {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.barbican_region_name = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.cafile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.collect_timing = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.insecure = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.number_of_retries = 60 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.retry_delay = 1 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.send_service_user_token = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.split_loggers = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.timeout = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.tls_ciphers = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.tls_min_version = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.verify_ssl = True {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican.verify_ssl_path = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.auth_section = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.auth_type = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.cafile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.certfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.collect_timing = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.insecure = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.keyfile = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.split_loggers = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.timeout = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.tls_ciphers = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] barbican_service_user.tls_min_version = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.approle_role_id = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.approle_secret_id = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.auth_method = approle {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.auth_path = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.kv_mountpoint = secret {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.kv_path = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.kv_version = 2 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.namespace = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.root_token_id = **** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.ssl_ca_crt_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.timeout = 60.0 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.token_file = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.token_role = None {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.use_ssl = False {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:45:38 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] ******************************************************************************** {{(pid=76289) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 11:45:38 devstack sudo[76460]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.310s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:38 devstack sudo[76467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:38 devstack sudo[76467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:38 devstack sudo[76467]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.277s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:45:38 devstack cinder-volume[76456]: INFO cinder.brick.local_dev.lvm [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:38 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:38 devstack sudo[76629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:45:38 devstack sudo[76629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:39 devstack sudo[76629]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:39 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.283s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:39 devstack cinder-volume[76456]: DEBUG cinder.brick.local_dev.lvm [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76456) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Sep 03 11:45:39 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:39 devstack sudo[76722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:39 devstack sudo[76722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:39 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.626s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:39 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:39 devstack sudo[76722]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:39 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.021s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:39 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:39 devstack sudo[76921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:39 devstack sudo[76921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:40 devstack sudo[76921]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.291s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.028s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:40 devstack sudo[77035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Sep 03 11:45:40 devstack sudo[77035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:40 devstack sudo[77035]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.314s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:40 devstack sudo[77074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:45:40 devstack sudo[77074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:40 devstack sudo[77074]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.287s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:40 devstack sudo[77134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:45:40 devstack sudo[77134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:40 devstack sudo[77134]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.294s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:40 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:40 devstack sudo[77161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:45:40 devstack sudo[77161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:41 devstack sudo[77161]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:41 devstack sudo[77170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:41 devstack sudo[77170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:41 devstack sudo[77170]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.318s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:41 devstack sudo[77254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:41 devstack sudo[77254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:41 devstack sudo[77254]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.263s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:41 devstack cinder-volume[76456]: INFO cinder.volume.drivers.lvm [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Enabling LVM thin provisioning by default because a thin pool exists. Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.019s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:41 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:41 devstack sudo[77258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:41 devstack sudo[77258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:42 devstack sudo[77258]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.275s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG cinder.volume.drivers.lvm [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Updating volume stats {{(pid=76456) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:42 devstack sudo[77261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:45:42 devstack sudo[77261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:42 devstack sudo[77261]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.274s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:42 devstack sudo[77271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:45:42 devstack sudo[77271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:42 devstack sudo[77271]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:42 devstack sudo[77274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:42 devstack sudo[77274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:42 devstack sudo[77274]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:42 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:42 devstack sudo[77277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:45:42 devstack sudo[77277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:43 devstack sudo[77277]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:43 devstack cinder-volume[76456]: INFO cinder.volume.driver [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG cinder.volume.driver [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76456) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG oslo_db.sqlalchemy.engines [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76456) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG dbcounter [-] [76456] Writer thread running {{(pid=76456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG cinder.db.api [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Building query based on filter {{(pid=76456) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG cinder.image.image_utils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76456) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 11:45:43 devstack cinder-volume[76456]: INFO cinder.keymgr.migration [None req-3c423f16-b83b-4165-8cb0-bff8d5d9d321 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG cinder.volume.drivers.lvm [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Updating volume stats {{(pid=76456) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:43 devstack sudo[77280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:45:43 devstack sudo[77280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:43 devstack sudo[77280]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:43 devstack sudo[77285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:45:43 devstack sudo[77285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:43 devstack sudo[77285]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:43 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:43 devstack sudo[77288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:43 devstack sudo[77288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:44 devstack sudo[77288]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.281s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:44 devstack sudo[77291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:45:44 devstack sudo[77291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:44 devstack sudo[77291]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG cinder.manager [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Notifying Schedulers of capabilities ... {{(pid=76456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:45:44 devstack cinder-volume[76456]: INFO cinder.volume.manager [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Driver initialization completed successfully. Sep 03 11:45:44 devstack cinder-volume[76456]: INFO cinder.manager [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Initiating service 2 cleanup Sep 03 11:45:44 devstack cinder-volume[76456]: INFO cinder.manager [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Service 2 cleanup completed. Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG cinder.service [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Creating RPC server for service cinder-volume {{(pid=76456) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG cinder.service [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76456) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 11:45:44 devstack cinder-volume[76456]: INFO cinder.volume.manager [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG cinder.volume.drivers.lvm [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Updating volume stats {{(pid=76456) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:44 devstack sudo[77294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:45:44 devstack sudo[77294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:44 devstack sudo[77294]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.273s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:44 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:44 devstack sudo[77299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:45:44 devstack sudo[77299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:45 devstack sudo[77299]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:45 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:45 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:45 devstack sudo[77303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:45:45 devstack sudo[77303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:45 devstack sudo[77303]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:45 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.240s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:45 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:45:45 devstack sudo[77309]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:45:45 devstack sudo[77309]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:45:45 devstack sudo[77309]: pam_unix(sudo:session): session closed for user root Sep 03 11:45:45 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.256s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:45:45 devstack cinder-volume[76456]: INFO cinder.volume.manager [None req-9c799ca6-ecb8-4052-a93b-38026d8eb9f7 None None] Driver post RPC initialization completed successfully. Sep 03 11:45:48 devstack cinder-volume[76289]: DEBUG dbcounter [-] [76289] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76289) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:45:55 devstack cinder-volume[76456]: DEBUG dbcounter [-] [76456] Writing DB stats cinder:SELECT=4 {{(pid=76456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:45:55 devstack cinder-volume[76456]: DEBUG dbcounter [-] [76456] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=76456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:46:12 devstack cinder-volume[76456]: DEBUG oslo_service.periodic_task [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:46:12 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread count: 6 {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:46:12 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread info: [<_MainThread(MainThread, started 137753938931840)>, , , , , ] {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:47:12 devstack cinder-volume[76456]: DEBUG oslo_service.periodic_task [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:47:12 devstack cinder-volume[76456]: DEBUG cinder.volume.drivers.lvm [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Updating volume stats {{(pid=76456) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:47:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:47:12 devstack sudo[79980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:47:12 devstack sudo[79980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:47:12 devstack sudo[79980]: pam_unix(sudo:session): session closed for user root Sep 03 11:47:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.276s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:47:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:47:12 devstack sudo[79983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:47:12 devstack sudo[79983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:47:13 devstack sudo[79983]: pam_unix(sudo:session): session closed for user root Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.264s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:47:13 devstack sudo[79986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:47:13 devstack sudo[79986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:47:13 devstack sudo[79986]: pam_unix(sudo:session): session closed for user root Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:47:13 devstack sudo[79992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:47:13 devstack sudo[79992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:47:13 devstack sudo[79992]: pam_unix(sudo:session): session closed for user root Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG cinder.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Notifying Schedulers of capabilities ... {{(pid=76456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG oslo_service.periodic_task [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread count: 6 {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:47:13 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread info: [<_MainThread(MainThread, started 137753938931840)>, , , , , ] {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:47:55 devstack cinder-volume[76456]: DEBUG dbcounter [-] [76456] Writing DB stats cinder:SELECT=1 {{(pid=76456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:47:55 devstack cinder-volume[76456]: DEBUG dbcounter [-] [76456] Writing DB stats cinder:UPDATE=1 {{(pid=76456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:48:12 devstack cinder-volume[76456]: DEBUG oslo_service.periodic_task [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:48:12 devstack cinder-volume[76456]: DEBUG cinder.volume.drivers.lvm [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Updating volume stats {{(pid=76456) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:48:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:48:12 devstack sudo[83616]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:48:12 devstack sudo[83616]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:48:12 devstack sudo[83616]: pam_unix(sudo:session): session closed for user root Sep 03 11:48:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.253s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:48:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:48:12 devstack sudo[83619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:48:12 devstack sudo[83619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:48:13 devstack sudo[83619]: pam_unix(sudo:session): session closed for user root Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.246s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:48:13 devstack sudo[83622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:48:13 devstack sudo[83622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:48:13 devstack sudo[83622]: pam_unix(sudo:session): session closed for user root Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.266s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:48:13 devstack sudo[83625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:48:13 devstack sudo[83625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:48:13 devstack sudo[83625]: pam_unix(sudo:session): session closed for user root Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.265s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG cinder.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Notifying Schedulers of capabilities ... {{(pid=76456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG oslo_service.periodic_task [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread count: 6 {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:48:13 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread info: [<_MainThread(MainThread, started 137753938931840)>, , , , , ] {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:49:12 devstack cinder-volume[76456]: DEBUG oslo_service.periodic_task [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:49:12 devstack cinder-volume[76456]: DEBUG cinder.volume.drivers.lvm [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Updating volume stats {{(pid=76456) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Sep 03 11:49:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:49:12 devstack sudo[85371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Sep 03 11:49:12 devstack sudo[85371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:49:12 devstack sudo[85371]: pam_unix(sudo:session): session closed for user root Sep 03 11:49:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.277s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:49:12 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:49:12 devstack sudo[85375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:49:12 devstack sudo[85375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:49:13 devstack sudo[85375]: pam_unix(sudo:session): session closed for user root Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.262s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:49:13 devstack sudo[85378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Sep 03 11:49:13 devstack sudo[85378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:49:13 devstack sudo[85378]: pam_unix(sudo:session): session closed for user root Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.264s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:49:13 devstack sudo[85392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Sep 03 11:49:13 devstack sudo[85392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:49:13 devstack sudo[85392]: pam_unix(sudo:session): session closed for user root Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG oslo_concurrency.processutils [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=76456) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG cinder.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Notifying Schedulers of capabilities ... {{(pid=76456) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG oslo_service.periodic_task [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] Running periodic task VolumeManager._thread_info {{(pid=76456) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread count: 6 {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:49:13 devstack cinder-volume[76456]: DEBUG cinder.volume.manager [None req-523d49e8-75f8-460e-a8a4-04bc20ab23c1 None None] thread info: [<_MainThread(MainThread, started 137753938931840)>, , , , , ] {{(pid=76456) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:49:55 devstack cinder-volume[76456]: DEBUG dbcounter [-] [76456] Writing DB stats cinder:SELECT=1 {{(pid=76456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:49:55 devstack cinder-volume[76456]: DEBUG dbcounter [-] [76456] Writing DB stats cinder:UPDATE=1 {{(pid=76456) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:50:07 devstack cinder-volume[76289]: INFO oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Caught SIGTERM, stopping children Sep 03 11:50:07 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Acquiring lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:50:07 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Acquired lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:50:07 devstack cinder-volume[76289]: DEBUG oslo_concurrency.lockutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Releasing lock "singleton_lock" {{(pid=76289) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:50:07 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Stop services. {{(pid=76289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 11:50:07 devstack cinder-volume[76289]: DEBUG oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Killing children. {{(pid=76289) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 11:50:07 devstack cinder-volume[76289]: INFO oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Waiting on 1 children to exit Sep 03 11:50:09 devstack cinder-volume[76456]: DEBUG oslo_concurrency.lockutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Acquiring lock "singleton_lock" {{(pid=76456) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:50:09 devstack cinder-volume[76456]: DEBUG oslo_concurrency.lockutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Acquired lock "singleton_lock" {{(pid=76456) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:50:09 devstack cinder-volume[76456]: DEBUG oslo_concurrency.lockutils [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Releasing lock "singleton_lock" {{(pid=76456) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:50:09 devstack cinder-volume[76456]: WARNING amqp [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:50:09 devstack cinder-volume[76456]: WARNING amqp [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:50:09 devstack cinder-volume[76289]: INFO oslo_service.backend._eventlet.service [None req-68c26a84-7e69-4ceb-824f-bfcffd672bda None None] Child 76456 exited with status 0 Sep 03 11:50:09 devstack cinder-volume[86430]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 11:50:09 devstack cinder-volume[86430]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:50:09 devstack cinder-volume[86430]: we strongly recommend against using it for new projects. Sep 03 11:50:09 devstack cinder-volume[86430]: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:50:09 devstack cinder-volume[86430]: framework. For more detail see Sep 03 11:50:09 devstack cinder-volume[86430]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:50:09 devstack cinder-volume[86430]: import eventlet # noqa Sep 03 11:50:11 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:50:11 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:50:11 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:50:12 devstack cinder-volume[86430]: INFO dbcounter [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Registered counter for database cinder Sep 03 11:50:12 devstack cinder-volume[86430]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86430) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG dbcounter [-] [86430] Writer thread running {{(pid=86430) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:50:13 devstack cinder-volume[86430]: INFO cinder.rpc [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 11:50:13 devstack cinder-volume[86430]: INFO cinder.rpc [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86430) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:13 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Determined volume DB was empty at startup. Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG cinder.volume.manager [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86430) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 11:50:13 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Service not found for updating active_backend_id, assuming default for driver init. Sep 03 11:50:13 devstack cinder-volume[86430]: WARNING stevedore.named [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:50:13 devstack cinder-volume[86430]: WARNING castellan.key_manager [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:50:13 devstack cinder-volume[86430]: WARNING cinder.keymgr.conf_key_mgr [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:50:13 devstack cinder-volume[86430]: INFO cinder.volume.manager [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_db.sqlalchemy.engines [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86430) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:13 devstack cinder-volume[86430]: INFO oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Starting 1 workers Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Started child 86682 {{(pid=86430) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Full set of CONF: {{(pid=86430) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] ******************************************************************************** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Configuration options gathered from: {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] ================================================================================ {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] allow_availability_zone_fallback = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] allow_compression_on_image_upload = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] allowed_direct_url_schemes = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] api_rate_limit = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] auth_strategy = keystone {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_availability_zone = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_host = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_stats_polling_interval = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86682]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backup_api_class = cinder.backup.api.API {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backup_name_template = backup-%s {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backup_use_same_host = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backup_use_temp_snapshot = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] chap_password = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] chap_username = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_internal_tenant_project_id = 885d68b99d33449fa05223534a07602f {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_internal_tenant_user_id = 4ae2cc3a8cb74390ba0d6c5ef8d31fb9 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cluster = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] compression_format = gzip {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] compute_api_class = cinder.compute.nova.API {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] config_dir = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] config_source = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] control_exchange = openstack {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] debug = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] default_availability_zone = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] default_group_type = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] default_volume_type = QuobyteHD {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] disk_geometry = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] driver_client_cert = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] driver_client_cert_key = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] driver_data_namespace = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] driver_ssl_cert_path = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] driver_ssl_cert_verify = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] driver_use_ssl = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] enable_new_services = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] enable_unsupported_driver = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] enabled_backends = ['QuobyteHD'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] enforce_multipath_for_image_xfer = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] filter_function = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_api_insecure = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_api_ssl_compression = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_ca_certificates_file = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_catalog_info = image:glance:publicURL {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_num_retries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance_request_timeout = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] goodness_function = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] graceful_shutdown_timeout = 5 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] group_api_class = cinder.group.api.API {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] host = devstack {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_compress_on_upload = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_conversion_address_space_limit = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_conversion_cpu_limit = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_conversion_disable = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_upload_use_cinder_backend = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_upload_use_internal_tenant = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_volume_cache_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_volume_cache_max_count = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] image_volume_cache_max_size_gb = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] init_host_max_objects_retrieval = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] instance_format = [instance: %(uuid)s] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] iscsi_target_flags = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] iscsi_write_cache = on {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] iser_helper = tgtadm {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] iser_ip_address = 192.168.122.215 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] iser_port = 3260 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_color = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_config_append = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_dir = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_file = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_options = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_rotate_interval = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_rotate_interval_type = days {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] log_rotation_type = none {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] max_age = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] max_logfile_count = 30 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] max_logfile_size_mb = 200 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] max_over_subscription_ratio = 20.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] message_reap_interval = 86400 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] message_ttl = 2592000 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] migration_create_volume_timeout_secs = 300 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] monkey_patch = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] monkey_patch_modules = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] my_ip = 192.168.122.215 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] no_snapshot_gb_quota = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] num_iser_scan_tries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] num_shell_tries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] num_volume_device_scan_tries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] nvmeof_conn_info_version = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] nvmet_ns_id = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] nvmet_port_id = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] osapi_max_limit = 1000 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] osapi_volume_ext_list = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] osapi_volume_listen_port = 8776 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] osapi_volume_use_ssl = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] osapi_volume_workers = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] per_volume_size_limit = -1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] periodic_fuzzy_delay = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] periodic_interval = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] public_endpoint = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] publish_errors = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] quota_backup_gigabytes = 1000 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] quota_backups = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] quota_gigabytes = 1000 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] quota_groups = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] quota_snapshots = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] quota_volumes = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] rate_limit_burst = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] rate_limit_except_level = CRITICAL {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] rate_limit_interval = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] reinit_driver_count = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] replication_device = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] report_discard_supported = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] report_interval = 120 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] reservation_clean_interval = 86400 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] reservation_expire = 86400 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] reserved_image_namespaces = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] reserved_percentage = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] rpc_response_timeout = 120 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] run_external_periodic_tasks = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] scst_target_driver = iscsi {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] scst_target_iqn_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_down_time = 720 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] shell_completion = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] snapshot_name_template = snapshot-%s {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] split_loggers = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] state_path = /opt/stack/data/cinder {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] storage_availability_zone = nova {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] storage_protocol = iSCSI {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] syslog_log_facility = LOG_USER {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86682]: INFO cinder.volume.manager [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.remotefs [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86682) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] target_helper = lioadm {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] target_ip_address = 192.168.122.215 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] target_port = 3260 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] target_protocol = iscsi {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] target_secondary_ip_addresses = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] trace_flags = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] transport_url = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] until_refresh = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] use_chap_auth = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] use_default_quota_class = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] use_journal = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] use_json = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] use_multipath_for_image_xfer = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] use_stderr = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] use_syslog = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] verify_glance_signatures = enabled {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_api_class = cinder.volume.api.API {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_backend_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_clear = zero {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_clear_ionice = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_clear_size = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_copy_bps_limit = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_dd_blocksize = 1M {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_name_template = volume-%s {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_service_inithost_offload = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volume_usage_audit_period = month {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] zoning_mode = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_concurrency.disable_process_locking = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.auth_section = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.auth_type = password {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.auth_version = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.cache = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.include_service_catalog = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.insecure = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.interface = public {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_password = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcache_username = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.region_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.service_type = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.backend = dogpile.cache.null {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.backend_argument = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.backend_expiration_time = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.config_prefix = cache.oslo {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.debug_cache_backend = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.enable_retry_client = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.enable_socket_keepalive = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.expiration_time = 600 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.hashclient_retry_attempts = 2 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.memcache_dead_retry = 300 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.memcache_pool_maxsize = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.memcache_sasl_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.password = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.proxies = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.redis_db = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.redis_server = localhost:6379 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.retry_attempts = 2 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.retry_delay = 0.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.socket_keepalive_count = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.socket_keepalive_idle = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.socket_keepalive_interval = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.socket_timeout = 1.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.tls_allowed_ciphers = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.tls_cafile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.tls_certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.tls_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.tls_keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cache.username = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] coordination.backend_url = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.asyncio_connection = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.asyncio_slave_connection = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.backend = sqlalchemy {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.connection = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.connection_debug = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.connection_parameters = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.connection_recycle_time = 3600 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.connection_trace = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.db_inc_retry_interval = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.db_max_retries = 20 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.db_max_retry_interval = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.db_retry_interval = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.max_overflow = 50 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.max_pool_size = 5 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.max_retries = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.mysql_wsrep_sync_wait = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.pool_timeout = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.retry_interval = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.slave_connection = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.sqlite_synchronous = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.synchronous_reader = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] database.use_db_reconnect = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_tracing.insecure = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.connection_string = messaging:// {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.es_doc_type = notification {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.es_scroll_size = 10000 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.es_scroll_time = 2m {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.filter_error_trace = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.hmac_keys = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.sentinel_service_name = mymaster {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.socket_timeout = 0.1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.trace_requests = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler.trace_sqlalchemy = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler_jaeger.process_tags = {} {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler_jaeger.service_name_prefix = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] profiler_otlp.service_name_prefix = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.enforce_new_defaults = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.policy_default_rule = default {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.policy_file = policy.yaml {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] privsep_osbrick.group = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] privsep_osbrick.helper_command = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] privsep_osbrick.user = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_sys_admin.group = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_sys_admin.helper_command = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] cinder_sys_admin.user = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.auth_section = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.auth_type = password {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.cafile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.collect_timing = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.insecure = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.send_service_user_token = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.split_loggers = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.timeout = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.tls_ciphers = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] service_user.tls_min_version = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.auth_section = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.auth_type = password {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.collect_timing = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.insecure = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.region_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.split_loggers = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.timeout = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.tls_ciphers = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] glance.tls_min_version = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.backend_availability_zone = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.chap_password = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.chap_username = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.disk_geometry = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.driver_client_cert = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.driver_client_cert_key = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.driver_data_namespace = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.driver_use_ssl = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.extra_capabilities = {} {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.filter_function = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.goodness_function = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.iscsi_target_flags = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.iscsi_write_cache = on {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.iser_helper = tgtadm {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.iser_port = 3260 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_host = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_login = admin {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_mount_options = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_password = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_private_key = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_share_path = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.num_shell_tries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.quobyte_volume_url = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.replication_device = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.report_discard_supported = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.reserved_percentage = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.target_helper = tgtadm {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.target_port = 3260 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.target_protocol = iscsi {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.trace_flags = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.unique_fqdn_network = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.use_chap_auth = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_backend_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_clear = zero {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_clear_ionice = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_clear_size = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_reports.file_event_handler = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_reports.log_dir = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.backend_availability_zone = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.backend_host = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.chap_password = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.chap_username = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.chiscsi_conf = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86682) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 11:50:13 devstack cinder-volume[86682]: WARNING cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 11:50:13 devstack cinder-volume[86682]: WARNING cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Running cmd (subprocess): mount.quobyte {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.disk_geometry = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.driver_client_cert = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.driver_data_namespace = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.driver_use_ssl = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.extra_capabilities = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.filter_function = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.goodness_function = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.iser_helper = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.iser_ip_address = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.iser_port = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.iser_target_prefix = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_host = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_login = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_mount_options = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_password = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_private_key = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_share_path = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_ssh_port = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.num_shell_tries = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.nvmet_port_id = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.replication_device = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.report_discard_supported = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.reserved_percentage = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.scst_target_driver = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.storage_protocol = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.target_helper = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.target_ip_address = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.target_port = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.target_prefix = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.target_protocol = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.trace_flags = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.use_chap_auth = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_clear = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_clear_size = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] QuobyteHD.volumes_dir = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.ssl = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_notifications.driver = [] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_notifications.retry = -1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] key_manager.fixed_key = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.barbican_api_version = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.barbican_endpoint = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.barbican_endpoint_type = public {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.barbican_region_name = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.cafile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.collect_timing = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.insecure = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.number_of_retries = 60 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.retry_delay = 1 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.send_service_user_token = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.split_loggers = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.timeout = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.tls_ciphers = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.tls_min_version = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.verify_ssl = True {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican.verify_ssl_path = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.auth_section = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.auth_type = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.cafile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.certfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.collect_timing = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.insecure = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.keyfile = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.split_loggers = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.timeout = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.tls_ciphers = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] barbican_service_user.tls_min_version = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.approle_role_id = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.approle_secret_id = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.auth_method = approle {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.auth_path = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.kv_mountpoint = secret {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.kv_path = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.kv_version = 2 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.namespace = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.root_token_id = **** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.ssl_ca_crt_file = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.timeout = 60.0 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.token_file = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.token_role = None {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.use_ssl = False {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:13 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] ******************************************************************************** {{(pid=86430) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 11:50:13 devstack quobyte-client[86687]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 11:50:13 devstack quobyte-client[86687]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] CMD "mount.quobyte" returned: 1 in 0.094s {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=86682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:50:13 devstack cinder-volume[86682]: INFO cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 ... Sep 03 11:50:13 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 -c /etc/quobyte/client-cinder.cfg {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:13 devstack sudo[86688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 -c /etc/quobyte/client-cinder.cfg Sep 03 11:50:13 devstack sudo[86688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:14 devstack sudo[86688]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.375s {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:14 devstack cinder-volume[86682]: INFO cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 succeeded Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=86682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.385s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:14 devstack sudo[86757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:50:14 devstack sudo[86757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:14 devstack sudo[86757]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.232s {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:14 devstack cinder-volume[86682]: INFO cinder.volume.driver [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Driver hasn't implemented _init_vendor_properties() Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.volume.driver [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.850830078125, 'free_capacity_gb': 1773.850830078125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86682) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_db.sqlalchemy.engines [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86682) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG dbcounter [-] [86682] Writer thread running {{(pid=86682) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.db.api [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Building query based on filter {{(pid=86682) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.image.image_utils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86682) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 11:50:14 devstack cinder-volume[86682]: INFO cinder.keymgr.migration [None req-b514617a-50f3-423a-9685-7f45661f45b9 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=86682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=86682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:14 devstack sudo[86760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:50:14 devstack sudo[86760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:14 devstack sudo[86760]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.226s {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.manager [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Notifying Schedulers of capabilities ... {{(pid=86682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:50:14 devstack cinder-volume[86682]: INFO cinder.volume.manager [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Driver initialization completed successfully. Sep 03 11:50:14 devstack cinder-volume[86682]: INFO cinder.manager [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Initiating service 3 cleanup Sep 03 11:50:14 devstack cinder-volume[86682]: INFO cinder.manager [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Service 3 cleanup completed. Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.service [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Creating RPC server for service cinder-volume {{(pid=86682) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.service [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86682) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 11:50:14 devstack cinder-volume[86682]: INFO cinder.volume.manager [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=86682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=86682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:50:14 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:14 devstack sudo[86763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:50:14 devstack sudo[86763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:15 devstack sudo[86763]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:15 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.258s {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:15 devstack cinder-volume[86682]: INFO cinder.volume.manager [None req-8487580f-9cb8-4d1a-b8db-523ccbc1e4d0 None None] Driver post RPC initialization completed successfully. Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=86682) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG cinder.volume.drivers.quobyte [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=86682) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86682) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:19 devstack sudo[86882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:50:19 devstack sudo[86882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:19 devstack sudo[86882]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG oslo_concurrency.processutils [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.220s {{(pid=86682) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:19 devstack cinder-volume[86682]: DEBUG cinder.manager [None req-d825b10e-a2c2-4f91-8290-e96ab7160915 None None] Notifying Schedulers of capabilities ... {{(pid=86682) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:50:21 devstack cinder-volume[86430]: INFO oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Caught SIGTERM, stopping children Sep 03 11:50:21 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Acquiring lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:50:21 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Acquired lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:50:21 devstack cinder-volume[86430]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Releasing lock "singleton_lock" {{(pid=86430) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:50:21 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Stop services. {{(pid=86430) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Sep 03 11:50:21 devstack cinder-volume[86430]: DEBUG oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Killing children. {{(pid=86430) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Sep 03 11:50:21 devstack cinder-volume[86430]: INFO oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Waiting on 1 children to exit Sep 03 11:50:23 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Acquiring lock "singleton_lock" {{(pid=86682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:50:23 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Acquired lock "singleton_lock" {{(pid=86682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:50:23 devstack cinder-volume[86682]: DEBUG oslo_concurrency.lockutils [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Releasing lock "singleton_lock" {{(pid=86682) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:50:23 devstack cinder-volume[86682]: WARNING amqp [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:50:23 devstack cinder-volume[86682]: WARNING amqp [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Received method (60, 30) during closing channel 1. This method will be ignored Sep 03 11:50:23 devstack cinder-volume[86430]: INFO oslo_service.backend._eventlet.service [None req-d9a4bd22-0275-44c6-a7af-d6d9d93f395b None None] Child 86682 exited with status 0 Sep 03 11:50:23 devstack cinder-volume[86964]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Sep 03 11:50:23 devstack cinder-volume[86964]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:50:23 devstack cinder-volume[86964]: we strongly recommend against using it for new projects. Sep 03 11:50:23 devstack cinder-volume[86964]: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:50:23 devstack cinder-volume[86964]: framework. For more detail see Sep 03 11:50:23 devstack cinder-volume[86964]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:50:23 devstack cinder-volume[86964]: import eventlet # noqa Sep 03 11:50:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86964) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Sep 03 11:50:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86964) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Sep 03 11:50:26 devstack cinder-volume[86964]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86964) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Sep 03 11:50:27 devstack cinder-volume[86964]: INFO dbcounter [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Registered counter for database cinder Sep 03 11:50:28 devstack cinder-volume[86964]: DEBUG oslo_db.sqlalchemy.engines [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:28 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writer thread running {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:50:28 devstack cinder-volume[86964]: INFO cinder.rpc [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Sep 03 11:50:28 devstack cinder-volume[86964]: INFO cinder.rpc [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Sep 03 11:50:28 devstack cinder-volume[86964]: DEBUG oslo_db.sqlalchemy.engines [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Determined volume DB was empty at startup. Sep 03 11:50:28 devstack cinder-volume[86964]: DEBUG cinder.volume.manager [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86964) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Sep 03 11:50:28 devstack cinder-volume[86964]: WARNING stevedore.named [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Sep 03 11:50:28 devstack cinder-volume[86964]: WARNING castellan.key_manager [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:50:28 devstack cinder-volume[86964]: WARNING cinder.keymgr.conf_key_mgr [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Sep 03 11:50:28 devstack cinder-volume[86964]: INFO cinder.volume.manager [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Image-volume cache disabled for host devstack@QuobyteHD. Sep 03 11:50:28 devstack cinder-volume[86964]: DEBUG oslo_db.sqlalchemy.engines [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86964) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:29 devstack cinder-volume[86964]: INFO oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Starting 1 workers Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Started child 87256 {{(pid=86964) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Full set of CONF: {{(pid=86964) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] ******************************************************************************** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] Configuration options gathered from: {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] ================================================================================ {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.service [-] Starting cinder-volume node (version 28.1.0) Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] allow_availability_zone_fallback = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] allow_compression_on_image_upload = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] allowed_direct_url_schemes = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] api_rate_limit = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] auth_strategy = keystone {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_availability_zone = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_host = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_stats_polling_interval = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backup_api_class = cinder.backup.api.API {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backup_name_template = backup-%s {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backup_use_same_host = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backup_use_temp_snapshot = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] chap_password = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] chap_username = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_internal_tenant_project_id = 885d68b99d33449fa05223534a07602f {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_internal_tenant_user_id = 4ae2cc3a8cb74390ba0d6c5ef8d31fb9 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cluster = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] compression_format = gzip {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] compute_api_class = cinder.compute.nova.API {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] config_dir = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] config_source = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] control_exchange = openstack {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] debug = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] default_availability_zone = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] default_group_type = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] default_volume_type = QuobyteHD {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] disk_geometry = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] driver_client_cert = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] driver_client_cert_key = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] driver_data_namespace = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] driver_ssl_cert_path = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] driver_ssl_cert_verify = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] driver_use_ssl = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] enable_new_services = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] enable_unsupported_driver = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] enabled_backends = ['QuobyteHD'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] enforce_multipath_for_image_xfer = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] filter_function = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_api_insecure = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_api_servers = ['http://192.168.122.215/image'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_api_ssl_compression = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_ca_certificates_file = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_catalog_info = image:glance:publicURL {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_num_retries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance_request_timeout = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] goodness_function = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] graceful_shutdown_timeout = 5 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] group_api_class = cinder.group.api.API {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Starting volume driver QuobyteDriver (1.2.1) Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=87256) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] host = devstack {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_compress_on_upload = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_conversion_address_space_limit = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_conversion_cpu_limit = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_conversion_disable = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_upload_use_cinder_backend = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_upload_use_internal_tenant = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_volume_cache_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_volume_cache_max_count = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] image_volume_cache_max_size_gb = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] init_host_max_objects_retrieval = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] instance_format = [instance: %(uuid)s] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] iscsi_target_flags = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] iscsi_write_cache = on {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] iser_helper = tgtadm {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] iser_ip_address = 192.168.122.215 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] iser_port = 3260 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_color = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_config_append = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_dir = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_file = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_options = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_rotate_interval = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_rotate_interval_type = days {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] log_rotation_type = none {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] max_age = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] max_logfile_count = 30 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] max_logfile_size_mb = 200 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] max_over_subscription_ratio = 20.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] message_reap_interval = 86400 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] message_ttl = 2592000 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] migration_create_volume_timeout_secs = 300 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] monkey_patch = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] monkey_patch_modules = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] my_ip = 192.168.122.215 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] no_snapshot_gb_quota = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] num_iser_scan_tries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] num_shell_tries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] num_volume_device_scan_tries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] nvmeof_conn_info_version = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] nvmet_ns_id = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] nvmet_port_id = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] osapi_max_limit = 1000 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] osapi_volume_ext_list = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] osapi_volume_listen = 0.0.0.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] osapi_volume_listen_port = 8776 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] osapi_volume_use_ssl = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] osapi_volume_workers = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] per_volume_size_limit = -1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] periodic_fuzzy_delay = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] periodic_interval = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] project_id_regex = [0-9a-f\-]+ {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] public_endpoint = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] publish_errors = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] quota_backup_gigabytes = 1000 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] quota_backups = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] quota_gigabytes = 1000 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] quota_groups = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] quota_snapshots = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] quota_volumes = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] rate_limit_burst = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] rate_limit_except_level = CRITICAL {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] rate_limit_interval = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] reinit_driver_count = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] replication_device = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] report_discard_supported = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] report_interval = 120 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] reservation_clean_interval = 86400 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] reservation_expire = 86400 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] reserved_image_namespaces = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] reserved_percentage = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] rpc_response_timeout = 120 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] run_external_periodic_tasks = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] scst_target_driver = iscsi {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] scst_target_iqn_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_down_time = 720 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] shell_completion = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] snapshot_name_template = snapshot-%s {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] split_loggers = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] state_path = /opt/stack/data/cinder {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] storage_availability_zone = nova {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] storage_protocol = iSCSI {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] syslog_log_facility = LOG_USER {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] target_helper = lioadm {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] target_ip_address = 192.168.122.215 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] target_port = 3260 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] target_protocol = iscsi {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] target_secondary_ip_addresses = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] trace_flags = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] transfer_api_class = cinder.transfer.api.API {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] transport_url = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] until_refresh = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] use_chap_auth = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] use_default_quota_class = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] use_journal = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] use_json = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] use_multipath_for_image_xfer = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] use_stderr = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] use_syslog = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] verify_glance_signatures = enabled {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_api_class = cinder.volume.api.API {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_backend_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_clear = zero {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_clear_ionice = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_clear_size = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_copy_bps_limit = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_dd_blocksize = 1M {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_name_template = volume-%s {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_service_inithost_offload = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volume_usage_audit_period = month {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] zoning_mode = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_concurrency.disable_process_locking = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.auth_section = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.auth_type = password {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.auth_version = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.cache = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.delay_auth_decision = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.http_connect_timeout = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.include_service_catalog = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.insecure = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.interface = public {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_password = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcache_username = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.region_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.service_token_roles_required = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.service_type = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.token_cache_time = 300 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.215/identity {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.backend = dogpile.cache.null {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.backend_argument = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.backend_expiration_time = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.config_prefix = cache.oslo {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.debug_cache_backend = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.enable_retry_client = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.enable_socket_keepalive = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.expiration_time = 600 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.hashclient_retry_attempts = 2 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.memcache_dead_retry = 300 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.memcache_pool_maxsize = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=87256) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.memcache_sasl_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Sep 03 11:50:29 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.password = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.proxies = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.redis_db = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.redis_sentinel_service_name = mymaster {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Running cmd (subprocess): mount.quobyte {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.redis_server = localhost:6379 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.retry_attempts = 2 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.retry_delay = 0.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.socket_keepalive_count = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.socket_keepalive_idle = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.socket_keepalive_interval = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.socket_timeout = 1.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.tls_allowed_ciphers = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.tls_cafile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.tls_certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.tls_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.tls_keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cache.username = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] coordination.backend_url = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.asyncio_connection = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.asyncio_slave_connection = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.backend = sqlalchemy {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.connection = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.connection_debug = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.connection_parameters = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.connection_recycle_time = 3600 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.connection_trace = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.db_inc_retry_interval = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.db_max_retries = 20 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.db_max_retry_interval = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.db_retry_interval = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.max_overflow = 50 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.max_pool_size = 5 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.max_retries = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.mysql_wsrep_sync_wait = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.pool_timeout = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.retry_interval = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.slave_connection = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.sqlite_synchronous = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.synchronous_reader = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] database.use_db_reconnect = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_tracing.insecure = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.connection_string = messaging:// {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.es_doc_type = notification {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.es_scroll_size = 10000 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.es_scroll_time = 2m {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.filter_error_trace = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.hmac_keys = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.sentinel_service_name = mymaster {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.socket_timeout = 0.1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.trace_requests = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler.trace_sqlalchemy = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler_jaeger.process_tags = {} {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler_jaeger.service_name_prefix = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] profiler_otlp.service_name_prefix = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.enforce_new_defaults = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.policy_default_rule = default {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.policy_file = policy.yaml {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_policy.remote_timeout = 60.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] privsep_osbrick.group = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] privsep_osbrick.helper_command = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] privsep_osbrick.user = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_sys_admin.group = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_sys_admin.helper_command = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] cinder_sys_admin.user = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.auth_section = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.auth_type = password {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.cafile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.collect_timing = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.insecure = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.send_service_user_token = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.split_loggers = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.timeout = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.tls_ciphers = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] service_user.tls_min_version = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.auth_section = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.auth_type = password {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.collect_timing = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.insecure = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.region_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.split_loggers = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.timeout = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.tls_ciphers = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] glance.tls_min_version = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.backend_availability_zone = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.chap_password = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.chap_username = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.disk_geometry = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.driver_client_cert = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.driver_client_cert_key = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.driver_data_namespace = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.driver_use_ssl = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.enable_unsupported_driver = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.extra_capabilities = {} {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.filter_function = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.goodness_function = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.iscsi_target_flags = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.iscsi_write_cache = on {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.iser_helper = tgtadm {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.iser_ip_address = 192.168.122.215 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.iser_port = 3260 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_host = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_login = admin {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_mount_options = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_password = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_private_key = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_share_path = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_ssh_port = 22 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.num_shell_tries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack quobyte-client[87257]: Reading configuration file: /etc/quobyte/client.cfg Sep 03 11:50:29 devstack quobyte-client[87257]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.nvmet_port_id = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.quobyte_client_cfg = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.quobyte_volume_url = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.replication_device = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.report_discard_supported = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.reserved_percentage = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] CMD "mount.quobyte" returned: 1 in 0.072s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.scst_target_driver = iscsi {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.scst_target_iqn_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.storage_protocol = iSCSI {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.target_helper = tgtadm {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.target_ip_address = 192.168.122.215 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.target_port = 3260 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.target_protocol = iscsi {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.trace_flags = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.unique_fqdn_network = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.use_chap_auth = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_backend_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_clear = zero {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_clear_ionice = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_clear_size = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_reports.file_event_handler = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_reports.log_dir = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.backend_availability_zone = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.backend_host = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.chap_password = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.chap_username = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.chiscsi_conf = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.disk_geometry = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.driver_client_cert = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.driver_client_cert_key = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.driver_data_namespace = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.driver_use_ssl = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.extra_capabilities = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.filter_function = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.goodness_function = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.iscsi_target_flags = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.iscsi_write_cache = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.iser_helper = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.iser_ip_address = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.iser_port = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.iser_target_prefix = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_host = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_login = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_mount_options = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_password = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_private_key = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_share_path = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_ssh_port = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.num_shell_tries = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nvmet_ns_id = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.nvmet_port_id = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.replication_device = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.report_discard_supported = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.reserved_percentage = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.scst_target_driver = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.storage_protocol = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.target_helper = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.target_ip_address = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.target_port = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.target_prefix = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.target_protocol = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.trace_flags = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.unique_fqdn_network = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.use_chap_auth = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_clear = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_clear_ionice = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_clear_size = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack sudo[87258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] QuobyteHD.volumes_dir = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack sudo[87258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.ssl = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.ssl_version = {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_notifications.driver = [] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_notifications.retry = -1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] oslo_messaging_notifications.transport_url = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] key_manager.fixed_key = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.barbican_api_version = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.barbican_endpoint = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.barbican_endpoint_type = public {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.barbican_region_name = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.cafile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.collect_timing = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.insecure = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.number_of_retries = 60 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.retry_delay = 1 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.send_service_user_token = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.split_loggers = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.timeout = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.tls_ciphers = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.tls_min_version = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.verify_ssl = True {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican.verify_ssl_path = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.auth_section = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.auth_type = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.cafile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.certfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.collect_timing = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.insecure = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.keyfile = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.split_loggers = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.timeout = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.tls_ciphers = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] barbican_service_user.tls_min_version = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.approle_role_id = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.approle_secret_id = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.auth_method = approle {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.auth_path = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.kv_mountpoint = secret {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.kv_path = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.kv_version = 2 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.namespace = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.root_token_id = **** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.ssl_ca_crt_file = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.timeout = 60.0 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.token_file = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.token_role = None {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.use_ssl = False {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Sep 03 11:50:29 devstack cinder-volume[86964]: DEBUG oslo_service.backend._eventlet.service [None req-aa51ba8a-b066-422b-9a13-7d5ea8edb74f None None] ******************************************************************************** {{(pid=86964) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Sep 03 11:50:29 devstack sudo[87258]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.238s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.volume.driver [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Driver hasn't implemented _init_vendor_properties() Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.driver [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.850830078125, 'free_capacity_gb': 1773.850830078125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87256) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_db.sqlalchemy.engines [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=87256) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writer thread running {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.db.api [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Building query based on filter {{(pid=87256) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=87256) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1301}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.keymgr.migration [None req-2ce3f397-b88e-453e-8aa2-56ae2a48a0fc None None] Not migrating encryption keys because the ConfKeyManager is still in use. Sep 03 11:50:29 devstack sudo[87269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:50:29 devstack sudo[87269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:29 devstack sudo[87269]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.230s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Driver initialization completed successfully. Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.manager [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Initiating service 3 cleanup Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.manager [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Service 3 cleanup completed. Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.service [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Creating RPC server for service cinder-volume {{(pid=87256) start /opt/stack/cinder/cinder/service.py:231}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.service [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=87256) start /opt/stack/cinder/cinder/service.py:237}} Sep 03 11:50:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:50:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:50:29 devstack sudo[87281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:50:29 devstack sudo[87281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:50:30 devstack sudo[87281]: pam_unix(sudo:session): session closed for user root Sep 03 11:50:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.238s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:50:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bb46e8f8-cb77-41cf-801b-610aadb21a2e None None] Driver post RPC initialization completed successfully. Sep 03 11:50:38 devstack cinder-volume[86964]: DEBUG dbcounter [-] [86964] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86964) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:50:39 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=3 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:50:40 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=7,cinder:UPDATE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:51:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:51:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 6 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:51:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Flow 'volume_create_manager' (a672b81b-ac88-4438-b2ed-5038ff5cb4dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559442ba-37ba-4008-a93f-a425fc1bc044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (559442ba-37ba-4008-a93f-a425fc1bc044) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1108501227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cc5f7c-146d-4800-80bf-fe4c3a17b18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc01ccf4def54c5a874fbf5c5f166963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:51:55Z,use_quota=True,user_id='bc408840bba243928946cb0364874b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a652ffe-ac30-4326-aa5e-38e2352c69d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a652ffe-ac30-4326-aa5e-38e2352c69d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446da867-9ed6-4baa-8456-f7523c665404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (446da867-9ed6-4baa-8456-f7523c665404) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '16cc5f7c-146d-4800-80bf-fe4c3a17b18e', 'volume_name': 'volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed4d05f-d6c9-495f-8098-905a82beeeb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ed4d05f-d6c9-495f-8098-905a82beeeb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90633900-228d-4fa8-85b0-27b36beb06be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:55 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Volume 16cc5f7c-146d-4800-80bf-fe4c3a17b18e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e', 'volume_size': 1} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:51:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1108501227',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=16cc5f7c-146d-4800-80bf-fe4c3a17b18e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bc01ccf4def54c5a874fbf5c5f166963',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:51:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:51:55Z,use_quota=True,user_id='bc408840bba243928946cb0364874b59',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Creating volume 16cc5f7c-146d-4800-80bf-fe4c3a17b18e {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:51:55 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:51:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:51:56 devstack sudo[88231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e 1073741824 Sep 03 11:51:56 devstack sudo[88231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:51:57 devstack sudo[88231]: pam_unix(sudo:session): session closed for user root Sep 03 11:51:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e 1073741824" returned: 0 in 1.515s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:51:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:51:57 devstack sudo[88554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e Sep 03 11:51:57 devstack sudo[88554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:51:57 devstack sudo[88554]: pam_unix(sudo:session): session closed for user root Sep 03 11:51:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e" returned: 0 in 0.468s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:51:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] <== create_volume: return (2085ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:51:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.094s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:51:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90633900-228d-4fa8-85b0-27b36beb06be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74e6472-50c5-4a71-89fe-fea57ae6c22e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:58 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Volume volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e (16cc5f7c-146d-4800-80bf-fe4c3a17b18e): created successfully Sep 03 11:51:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74e6472-50c5-4a71-89fe-fea57ae6c22e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Flow 'volume_create_manager' (a672b81b-ac88-4438-b2ed-5038ff5cb4dc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:51:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b105d7c5-e27b-443f-932d-f0a37544d525 tempest-VolumesAdminNegativeTest-2128257275 None] Created volume successfully. Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Acquiring lock "cinder-16cc5f7c-146d-4800-80bf-fe4c3a17b18e-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "cinder-16cc5f7c-146d-4800-80bf-fe4c3a17b18e-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Acquiring lock "cinder-quobyte-16cc5f7c-146d-4800-80bf-fe4c3a17b18e" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "cinder-quobyte-16cc5f7c-146d-4800-80bf-fe4c3a17b18e" acquired by "delete_volume" :: waited 0.044s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:51:59 devstack cinder-volume[87256]: INFO oslo.privsep.daemon [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpwy16ysw9/privsep.sock'] Sep 03 11:51:59 devstack sudo[88579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpwy16ysw9/privsep.sock Sep 03 11:51:59 devstack sudo[88579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Flow 'volume_create_manager' (166baf02-8f8a-4e95-a729-6ced28cfde4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fca651-eed9-45a2-b6d5-48653a7675ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c2fca651-eed9-45a2-b6d5-48653a7675ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1285118661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffb8ca5-50ed-4fae-9c42-d94e205b143c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcdc16e8e6f4ee0b8fe1a486fd6a763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:52:00Z,use_quota=True,user_id='a0cb6352542945cca1b39cece19f1d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0877fe65-0253-42c3-bdb3-df60add2c5c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0877fe65-0253-42c3-bdb3-df60add2c5c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f82b064-0171-474c-83d3-73c064010d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f82b064-0171-474c-83d3-73c064010d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6ffb8ca5-50ed-4fae-9c42-d94e205b143c', 'volume_name': 'volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cc4329-df3e-40e5-b648-cc425a5d1dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26cc4329-df3e-40e5-b648-cc425a5d1dc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159f31fb-d57d-4720-91f0-9ccb49599068) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:51:59 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Volume 6ffb8ca5-50ed-4fae-9c42-d94e205b143c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c', 'volume_size': 1} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:51:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:51:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-1285118661',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ffb8ca5-50ed-4fae-9c42-d94e205b143c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fcdc16e8e6f4ee0b8fe1a486fd6a763',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:52:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:52:00Z,use_quota=True,user_id='a0cb6352542945cca1b39cece19f1d04',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Creating volume 6ffb8ca5-50ed-4fae-9c42-d94e205b143c {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:52:00 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:00 devstack sudo[88582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c 1073741824 Sep 03 11:52:00 devstack sudo[88582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:00 devstack sudo[88582]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c 1073741824" returned: 0 in 0.782s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:00 devstack sudo[88587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c Sep 03 11:52:00 devstack sudo[88587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: Sep 03 11:52:01 devstack cinder-volume[87256]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Sep 03 11:52:01 devstack sudo[88579]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:01 devstack cinder-volume[87256]: INFO oslo.privsep.daemon [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Spawned new privsep daemon via rootwrap Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Accepted privsep connection to /tmp/tmpwy16ysw9/privsep.sock {{(pid=87256) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Sep 03 11:52:01 devstack cinder-volume[87256]: INFO oslo.privsep.daemon [-] privsep daemon starting Sep 03 11:52:01 devstack cinder-volume[87256]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Sep 03 11:52:01 devstack cinder-volume[87256]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Sep 03 11:52:01 devstack cinder-volume[87256]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 88589 Sep 03 11:52:01 devstack sudo[88587]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[097cf030-796d-48fb-b7cf-61758ae075f4]: (2,) {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c" returned: 0 in 0.604s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] <== create_volume: return (1479ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.485s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (159f31fb-d57d-4720-91f0-9ccb49599068) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c596d4-8144-4839-b49a-3705fd03622b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[962df383-08d1-43c5-bab9-f0e3958bbdd8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:01 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Volume volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c (6ffb8ca5-50ed-4fae-9c42-d94e205b143c): created successfully Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e7c596d4-8144-4839-b49a-3705fd03622b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Flow 'volume_create_manager' (166baf02-8f8a-4e95-a729-6ced28cfde4d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:52:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5a0689c2-b3db-4a1c-acb4-037a8f454bf4 tempest-ServerRescueNegativeTestJSON-303391095 None] Created volume successfully. Sep 03 11:52:01 devstack sudo[88592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e Sep 03 11:52:01 devstack sudo[88592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:02 devstack sudo[88592]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e" returned: 0 in 0.652s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:02 devstack sudo[88598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e Sep 03 11:52:02 devstack sudo[88598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:02 devstack sudo[88598]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-16cc5f7c-146d-4800-80bf-fe4c3a17b18e" returned: 0 in 0.576s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "cinder-quobyte-16cc5f7c-146d-4800-80bf-fe4c3a17b18e" released by "delete_volume" :: held 3.396s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:52:02 devstack cinder-volume[87256]: WARNING cinder.quota [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:52:02 devstack cinder-volume[87256]: WARNING cinder.quota [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Created reservations ['5a6c1029-11c4-46dd-a778-dff6f3d6196c', 'ceb2c0e7-e780-4f0b-9350-b17f348a2305', 'c6bef5d3-ae1f-4ac7-803c-101b8b20318e', '29024839-db11-40bb-8130-db7c856a0fd0'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:03 devstack sudo[88604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:52:03 devstack sudo[88604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:03 devstack sudo[88604]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.565s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:52:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Deleted volume successfully. Sep 03 11:52:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d25739e6-7d4c-47d7-88f0-46dff65f0b05 tempest-VolumesAdminNegativeTest-2128257275 None] Lock "cinder-16cc5f7c-146d-4800-80bf-fe4c3a17b18e-delete_volume" released by "delete_volume" :: held 4.577s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Flow 'volume_create_manager' (3125f3b6-558b-4a97-8ea1-ac686ccfc40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d001b619-2a1c-4738-8703-21f2da345c77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d001b619-2a1c-4738-8703-21f2da345c77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-835047998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd282923-43bf-46f6-a462-1de7347895e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b006070bc92c49e7beff874f656a7cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:52:11Z,use_quota=True,user_id='610313d9106541e793c77472f2fdf73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d755a2b-bdd7-44b9-aa6e-0c40ce80d50f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d755a2b-bdd7-44b9-aa6e-0c40ce80d50f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a745d3-75f0-4cd4-b3ec-f1525a38b2b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (61a745d3-75f0-4cd4-b3ec-f1525a38b2b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd282923-43bf-46f6-a462-1de7347895e0', 'volume_name': 'volume-fd282923-43bf-46f6-a462-1de7347895e0', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e3f6b0-9952-465d-9fdd-18d62f460a1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13e3f6b0-9952-465d-9fdd-18d62f460a1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5902d46b-8dba-45a2-bee1-8790490a136b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:11 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Volume fd282923-43bf-46f6-a462-1de7347895e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd282923-43bf-46f6-a462-1de7347895e0', 'volume_size': 1} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:52:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-835047998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd282923-43bf-46f6-a462-1de7347895e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b006070bc92c49e7beff874f656a7cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:52:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:52:11Z,use_quota=True,user_id='610313d9106541e793c77472f2fdf73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Creating volume fd282923-43bf-46f6-a462-1de7347895e0 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:52:11 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:52:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:11 devstack sudo[88703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 1073741824 Sep 03 11:52:11 devstack sudo[88703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:12 devstack sudo[88703]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 1073741824" returned: 0 in 0.692s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:12 devstack sudo[88723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 Sep 03 11:52:12 devstack sudo[88723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:12 devstack sudo[88723]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0" returned: 0 in 0.408s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] <== create_volume: return (1381ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:52:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.385s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5902d46b-8dba-45a2-bee1-8790490a136b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd282923-43bf-46f6-a462-1de7347895e0', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5092c8a5-f377-4c60-b123-ffee57d7f31f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:12 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Volume volume-fd282923-43bf-46f6-a462-1de7347895e0 (fd282923-43bf-46f6-a462-1de7347895e0): created successfully Sep 03 11:52:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5092c8a5-f377-4c60-b123-ffee57d7f31f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Flow 'volume_create_manager' (3125f3b6-558b-4a97-8ea1-ac686ccfc40c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:52:13 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8ab1c71c-e312-49bf-b02a-5f06e45f6992 tempest-ServerActionsTestOtherA-1835155833 None] Created volume successfully. Sep 03 11:52:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Acquiring lock "cinder-6ffb8ca5-50ed-4fae-9c42-d94e205b143c-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:52:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "cinder-6ffb8ca5-50ed-4fae-9c42-d94e205b143c-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:52:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Acquiring lock "cinder-quobyte-6ffb8ca5-50ed-4fae-9c42-d94e205b143c" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:52:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "cinder-quobyte-6ffb8ca5-50ed-4fae-9c42-d94e205b143c" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:52:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19f5d4f-f05f-479f-9bdd-e6e609c33940]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:52:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:14 devstack sudo[88752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c Sep 03 11:52:14 devstack sudo[88752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:15 devstack sudo[88752]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c" returned: 0 in 0.755s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:15 devstack sudo[88781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c Sep 03 11:52:15 devstack sudo[88781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:15 devstack sudo[88781]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6ffb8ca5-50ed-4fae-9c42-d94e205b143c" returned: 0 in 0.683s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "cinder-quobyte-6ffb8ca5-50ed-4fae-9c42-d94e205b143c" released by "delete_volume" :: held 1.533s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Created reservations ['c0437070-b9b7-49ae-b96e-6e88396ec239', '40091b26-b069-4605-b7b7-09a4fd030c7b', '7b70f1af-abb6-42f7-be29-06229d579b9e', 'f7311ca7-33e7-47b5-bfd7-4e44c12ea919'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:16 devstack sudo[88784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:52:16 devstack sudo[88784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:16 devstack sudo[88786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:52:16 devstack sudo[88786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:16 devstack sudo[88784]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.404s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:52:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Deleted volume successfully. Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f3260237-0dad-4776-bb26-71477255ea86 tempest-ServerRescueNegativeTestJSON-303391095 None] Lock "cinder-6ffb8ca5-50ed-4fae-9c42-d94e205b143c-delete_volume" released by "delete_volume" :: held 2.388s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:52:16 devstack sudo[88786]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.563s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 8 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:52:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:52:25 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=23,cinder:SELECT=16,cinder:INSERT=6,cinder:DELETE=3 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:52:26 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=16,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=5 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:52:40 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:52:40 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Flow 'volume_create_manager' (34dde0e3-eebc-4ab5-8d1b-2f17f4bbb229) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc131ad-37ca-46f3-a9df-3aade8a7ac95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9fc131ad-37ca-46f3-a9df-3aade8a7ac95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1722192947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6764e35-faf5-4a54-a76c-8f3e2327b501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4864cd0f3164d8da558c048a73bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:52:49Z,use_quota=True,user_id='42bba01bfcec4488afc52863106b7e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f3acb8-0cd0-41a8-b09b-7fd27a213a52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7f3acb8-0cd0-41a8-b09b-7fd27a213a52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a94c73-8e00-429e-a565-0b4b1e8196c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (31a94c73-8e00-429e-a565-0b4b1e8196c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6764e35-faf5-4a54-a76c-8f3e2327b501', 'volume_name': 'volume-f6764e35-faf5-4a54-a76c-8f3e2327b501', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6dce24-00b1-46ca-9206-7480cc2eaa95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f6dce24-00b1-46ca-9206-7480cc2eaa95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de28ce5f-a9f1-4bad-8098-900de9dd9de2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Volume f6764e35-faf5-4a54-a76c-8f3e2327b501: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6764e35-faf5-4a54-a76c-8f3e2327b501', 'volume_size': 1} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:52:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1722192947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6764e35-faf5-4a54-a76c-8f3e2327b501,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e4864cd0f3164d8da558c048a73bd1f1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:52:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:52:49Z,use_quota=True,user_id='42bba01bfcec4488afc52863106b7e43',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Creating volume f6764e35-faf5-4a54-a76c-8f3e2327b501 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:52:49 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:52:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:49 devstack sudo[89052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 1073741824 Sep 03 11:52:49 devstack sudo[89052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:50 devstack sudo[89052]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 1073741824" returned: 0 in 1.101s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:52:51 devstack sudo[89057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 Sep 03 11:52:51 devstack sudo[89057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:52:51 devstack sudo[89057]: pam_unix(sudo:session): session closed for user root Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501" returned: 0 in 0.559s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] <== create_volume: return (1778ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.788s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de28ce5f-a9f1-4bad-8098-900de9dd9de2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6764e35-faf5-4a54-a76c-8f3e2327b501', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93550e5-5ac3-4ec3-b3c8-a5e685a97e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:52:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Volume volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 (f6764e35-faf5-4a54-a76c-8f3e2327b501): created successfully Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d93550e5-5ac3-4ec3-b3c8-a5e685a97e99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:52:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Flow 'volume_create_manager' (34dde0e3-eebc-4ab5-8d1b-2f17f4bbb229) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:52:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fd4b41c9-b0bf-48ab-9f59-aae07bfcfb8b tempest-DeleteServersTestJSON-1491370143 None] Created volume successfully. Sep 03 11:52:56 devstack cinder-volume[87256]: WARNING py.warnings [req-20fe1c00-896e-46fc-8132-2a882687f0a1 req-1ba67df4-4993-4340-824b-27d90ebbfc44 tempest-DeleteServersTestJSON-1491370143 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes" and FROM element "volume_attachment". Apply join condition(s) between each element to resolve. Sep 03 11:52:56 devstack cinder-volume[87256]: .first() Sep 03 11:52:56 devstack cinder-volume[87256]: Sep 03 11:52:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-20fe1c00-896e-46fc-8132-2a882687f0a1 req-1ba67df4-4993-4340-824b-27d90ebbfc44 tempest-DeleteServersTestJSON-1491370143 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:52:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-20fe1c00-896e-46fc-8132-2a882687f0a1 req-1ba67df4-4993-4340-824b-27d90ebbfc44 tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:52:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-20fe1c00-896e-46fc-8132-2a882687f0a1 req-1ba67df4-4993-4340-824b-27d90ebbfc44 tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:52:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-20fe1c00-896e-46fc-8132-2a882687f0a1 req-1ba67df4-4993-4340-824b-27d90ebbfc44 tempest-DeleteServersTestJSON-1491370143 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-f6764e35-faf5-4a54-a76c-8f3e2327b501', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ea73c149-5104-4b83-94b1-6dfb0952203e', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:52:56 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-20fe1c00-896e-46fc-8132-2a882687f0a1 req-1ba67df4-4993-4340-824b-27d90ebbfc44 tempest-DeleteServersTestJSON-1491370143 None] attachment_update completed successfully. Sep 03 11:53:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-0764c268-83d2-46c4-94e1-766a86a946ea req-817d6a3c-16e1-4a32-a0d7-08b94bf31e26 tempest-DeleteServersTestJSON-1491370143 None] Terminate volume connection completed successfully. Sep 03 11:53:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-0764c268-83d2-46c4-94e1-766a86a946ea req-817d6a3c-16e1-4a32-a0d7-08b94bf31e26 tempest-DeleteServersTestJSON-1491370143 None] Deleting attachment ea73c149-5104-4b83-94b1-6dfb0952203e. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:53:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-5dcaaea1-56d4-4dc0-9316-9132dd3c07aa req-6b473708-909a-420b-aca0-7dce6aad5856 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-5dcaaea1-56d4-4dc0-9316-9132dd3c07aa req-6b473708-909a-420b-aca0-7dce6aad5856 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-5dcaaea1-56d4-4dc0-9316-9132dd3c07aa req-6b473708-909a-420b-aca0-7dce6aad5856 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-5dcaaea1-56d4-4dc0-9316-9132dd3c07aa req-6b473708-909a-420b-aca0-7dce6aad5856 tempest-ServerActionsTestOtherA-1835155833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-fd282923-43bf-46f6-a462-1de7347895e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '356c051a-74d9-4536-af15-0cb39bca0a86', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:53:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-5dcaaea1-56d4-4dc0-9316-9132dd3c07aa req-6b473708-909a-420b-aca0-7dce6aad5856 tempest-ServerActionsTestOtherA-1835155833 None] attachment_update completed successfully. Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Acquiring lock "cinder-f6764e35-faf5-4a54-a76c-8f3e2327b501-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Lock "cinder-f6764e35-faf5-4a54-a76c-8f3e2327b501-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Acquiring lock "cinder-quobyte-f6764e35-faf5-4a54-a76c-8f3e2327b501" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Lock "cinder-quobyte-f6764e35-faf5-4a54-a76c-8f3e2327b501" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab13ea89-9264-43d2-aa53-64d2a7408d09]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:06 devstack sudo[90028]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 Sep 03 11:53:06 devstack sudo[90028]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:06 devstack sudo[90028]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501" returned: 0 in 0.563s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:07 devstack sudo[90037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501 Sep 03 11:53:07 devstack sudo[90037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:07 devstack sudo[90037]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6764e35-faf5-4a54-a76c-8f3e2327b501" returned: 0 in 0.564s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Lock "cinder-quobyte-f6764e35-faf5-4a54-a76c-8f3e2327b501" released by "delete_volume" :: held 1.187s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Created reservations ['c478c533-7ebf-4bb6-af5f-2450f1d41b46', 'f6ac1d35-6908-477e-98d0-fa0f3f7314f0', '4f3febdb-b073-47b0-8efd-c56db533ac6e', '3a5f71af-d091-4702-ada3-13d06168315a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:07 devstack sudo[90040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:53:07 devstack sudo[90040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:08 devstack sudo[90040]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.388s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:08 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:53:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Deleted volume successfully. Sep 03 11:53:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-565c2355-247b-4689-b63d-3269289760e8 tempest-DeleteServersTestJSON-1491370143 None] Lock "cinder-f6764e35-faf5-4a54-a76c-8f3e2327b501-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:53:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-e0661af9-b2e8-40c3-bf37-1033a275c42a req-955183cc-e3e4-4b61-85ac-0416f223b8c9 tempest-ServerActionsTestOtherA-1835155833 None] Terminate volume connection completed successfully. Sep 03 11:53:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-e0661af9-b2e8-40c3-bf37-1033a275c42a req-955183cc-e3e4-4b61-85ac-0416f223b8c9 tempest-ServerActionsTestOtherA-1835155833 None] Deleting attachment 356c051a-74d9-4536-af15-0cb39bca0a86. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:53:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-e0661af9-b2e8-40c3-bf37-1033a275c42a req-ac8e5d19-feef-438e-91c0-770fd868a6e6 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-e0661af9-b2e8-40c3-bf37-1033a275c42a req-ac8e5d19-feef-438e-91c0-770fd868a6e6 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-e0661af9-b2e8-40c3-bf37-1033a275c42a req-ac8e5d19-feef-438e-91c0-770fd868a6e6 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-e0661af9-b2e8-40c3-bf37-1033a275c42a req-ac8e5d19-feef-438e-91c0-770fd868a6e6 tempest-ServerActionsTestOtherA-1835155833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-fd282923-43bf-46f6-a462-1de7347895e0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b0906c5c-4190-4484-b5af-a381efabc38a', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:53:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-e0661af9-b2e8-40c3-bf37-1033a275c42a req-ac8e5d19-feef-438e-91c0-770fd868a6e6 tempest-ServerActionsTestOtherA-1835155833 None] attachment_update completed successfully. Sep 03 11:53:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:53:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:53:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:53:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:16 devstack sudo[90610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:53:16 devstack sudo[90610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:17 devstack sudo[90610]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.935s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:17 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:53:21 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=28,cinder:UPDATE=19,cinder:INSERT=5 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:53:21 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=12,cinder:SELECT=29,cinder:DELETE=2 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Flow 'volume_create_manager' (b84b131c-2fc3-4475-a8a2-69afbb8c6597) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9c3191-8435-4a80-b957-4505a47a4c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a9c3191-8435-4a80-b957-4505a47a4c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2089450390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e59e15e-8ea1-4c1f-b18d-23f5652391f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d012925f6e4e959d303abe4e3cfe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:53:34Z,use_quota=True,user_id='b016cad62d87440d85762a23557fc2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61efb874-dee0-4fae-8756-52df09b43eb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (61efb874-dee0-4fae-8756-52df09b43eb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8cfb6-bc08-4c09-b13f-b4335f00f021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8cfb6-bc08-4c09-b13f-b4335f00f021) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9e59e15e-8ea1-4c1f-b18d-23f5652391f7', 'volume_name': 'volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2719f1-e613-41a1-86f4-384d693c9d34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9c2719f1-e613-41a1-86f4-384d693c9d34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe67d57-1a39-4012-abe1-74936e15cf09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Volume 9e59e15e-8ea1-4c1f-b18d-23f5652391f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7', 'volume_size': 1} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:53:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2089450390',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9e59e15e-8ea1-4c1f-b18d-23f5652391f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d012925f6e4e959d303abe4e3cfe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:53:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:53:34Z,use_quota=True,user_id='b016cad62d87440d85762a23557fc2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Creating volume 9e59e15e-8ea1-4c1f-b18d-23f5652391f7 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:53:34 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:53:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:34 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 1073741824 Sep 03 11:53:34 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:35 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 1073741824" returned: 0 in 0.664s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:35 devstack sudo[90932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 Sep 03 11:53:35 devstack sudo[90932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:35 devstack sudo[90932]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7" returned: 0 in 0.355s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] <== create_volume: return (1108ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.111s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe67d57-1a39-4012-abe1-74936e15cf09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990a4a3a-b397-464d-a01e-3aa92d9ac265) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:35 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Volume volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 (9e59e15e-8ea1-4c1f-b18d-23f5652391f7): created successfully Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (990a4a3a-b397-464d-a01e-3aa92d9ac265) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Flow 'volume_create_manager' (b84b131c-2fc3-4475-a8a2-69afbb8c6597) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:53:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-050d4e39-8d97-4d8e-9881-b6703181aa02 tempest-ServersNegativeTestJSON-159614700 None] Created volume successfully. Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Flow 'volume_create_manager' (b0d0f332-6c48-46d6-a7be-eb0a728dc895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b2d1d1-9d0d-4af9-bdc7-d6afff0f0f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1b2d1d1-9d0d-4af9-bdc7-d6afff0f0f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-577081123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8822c64-15ae-4e1f-b7ad-11a551c8fe86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d012925f6e4e959d303abe4e3cfe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:53:41Z,use_quota=True,user_id='b016cad62d87440d85762a23557fc2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b710e11e-73ff-4e53-b99c-fc271643705c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b710e11e-73ff-4e53-b99c-fc271643705c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523542f5-e227-49f5-a2c7-a011f4e17cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (523542f5-e227-49f5-a2c7-a011f4e17cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b8822c64-15ae-4e1f-b7ad-11a551c8fe86', 'volume_name': 'volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ca81fd-3c99-4290-94f2-e76290846a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ca81fd-3c99-4290-94f2-e76290846a7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ec93c7-251b-466e-b0c5-7d3ce8cf0f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:41 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Volume b8822c64-15ae-4e1f-b7ad-11a551c8fe86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86', 'volume_size': 1} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:53:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-577081123',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b8822c64-15ae-4e1f-b7ad-11a551c8fe86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14d012925f6e4e959d303abe4e3cfe28',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:53:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:53:41Z,use_quota=True,user_id='b016cad62d87440d85762a23557fc2d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Creating volume b8822c64-15ae-4e1f-b7ad-11a551c8fe86 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:53:41 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:53:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:41 devstack sudo[90946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 1073741824 Sep 03 11:53:41 devstack sudo[90946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:42 devstack sudo[90946]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 1073741824" returned: 0 in 0.623s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:42 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 Sep 03 11:53:42 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:42 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86" returned: 0 in 0.319s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] <== create_volume: return (1021ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.023s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92ec93c7-251b-466e-b0c5-7d3ce8cf0f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e2ad9a-c2e0-464a-ace4-175a25aa7be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:42 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Volume volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 (b8822c64-15ae-4e1f-b7ad-11a551c8fe86): created successfully Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (51e2ad9a-c2e0-464a-ace4-175a25aa7be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Flow 'volume_create_manager' (b0d0f332-6c48-46d6-a7be-eb0a728dc895) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:53:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-646e629c-21bf-4dfc-90a5-ca944b6b7478 tempest-ServersNegativeTestJSON-159614700 None] Created volume successfully. Sep 03 11:53:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "cinder-b8822c64-15ae-4e1f-b7ad-11a551c8fe86-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:53:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-b8822c64-15ae-4e1f-b7ad-11a551c8fe86-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:53:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "cinder-quobyte-b8822c64-15ae-4e1f-b7ad-11a551c8fe86" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:53:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-quobyte-b8822c64-15ae-4e1f-b7ad-11a551c8fe86" acquired by "delete_volume" :: waited 0.047s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:53:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5563075a-b239-4f84-9662-879aa0b863be]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:53:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:44 devstack sudo[90958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 Sep 03 11:53:44 devstack sudo[90958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:45 devstack sudo[90958]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86" returned: 0 in 0.602s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:45 devstack sudo[90964]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86 Sep 03 11:53:45 devstack sudo[90964]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:45 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-53277a3c-2c98-4586-97fd-30a350e8c15c req-7cc32ee8-0022-47c6-a92b-88fcc3cd2f4f tempest-ServerActionsTestOtherA-1835155833 None] Terminate volume connection completed successfully. Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-53277a3c-2c98-4586-97fd-30a350e8c15c req-7cc32ee8-0022-47c6-a92b-88fcc3cd2f4f tempest-ServerActionsTestOtherA-1835155833 None] Deleting attachment b0906c5c-4190-4484-b5af-a381efabc38a. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:53:45 devstack sudo[90964]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b8822c64-15ae-4e1f-b7ad-11a551c8fe86" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-quobyte-b8822c64-15ae-4e1f-b7ad-11a551c8fe86" released by "delete_volume" :: held 0.968s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Created reservations ['2e4178cc-2a15-4683-8f4a-4124c11c3eba', '08732629-0559-43a8-b76e-132b04a837c8', '17e91811-da35-4bd5-a6be-34a9898855b0', '594522c5-b334-4d85-9715-327a5829f98e'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:45 devstack sudo[90970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:53:45 devstack sudo[90970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:45 devstack sudo[90970]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.277s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:53:45 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Deleted volume successfully. Sep 03 11:53:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8ad6fd06-89af-44a8-ace0-dc594014a60e tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-b8822c64-15ae-4e1f-b7ad-11a551c8fe86-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:53:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "cinder-9e59e15e-8ea1-4c1f-b18d-23f5652391f7-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:53:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-9e59e15e-8ea1-4c1f-b18d-23f5652391f7-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:53:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "cinder-quobyte-9e59e15e-8ea1-4c1f-b18d-23f5652391f7" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:53:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-quobyte-9e59e15e-8ea1-4c1f-b18d-23f5652391f7" acquired by "delete_volume" :: waited 0.055s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:53:46 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2876683-8fd6-41ed-847a-7f4fcd3c6e9c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:53:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:47 devstack sudo[90988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 Sep 03 11:53:47 devstack sudo[90988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:47 devstack sudo[90988]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7" returned: 0 in 0.574s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:47 devstack sudo[91003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7 Sep 03 11:53:47 devstack sudo[91003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:47 devstack sudo[91003]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9e59e15e-8ea1-4c1f-b18d-23f5652391f7" returned: 0 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-quobyte-9e59e15e-8ea1-4c1f-b18d-23f5652391f7" released by "delete_volume" :: held 1.019s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:53:47 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Created reservations ['42fb1550-2587-4070-b81a-e80f70ef037d', '598b4d67-dd90-48fa-880c-8764b81cd22a', '81132a44-065f-4f37-bf12-8a84e90b5c89', '312b6bb5-2ac9-4ec9-b67f-4b5c5882a9d2'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:48 devstack sudo[91022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:53:48 devstack sudo[91022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:48 devstack sudo[91022]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:53:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Deleted volume successfully. Sep 03 11:53:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37d1d38d-89dd-4e99-939f-28589ab47639 tempest-ServersNegativeTestJSON-159614700 None] Lock "cinder-9e59e15e-8ea1-4c1f-b18d-23f5652391f7-delete_volume" released by "delete_volume" :: held 1.873s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Flow 'volume_create_manager' (65addedc-01d0-4990-9d65-9ffe3de66254) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaade22-11d3-4d0b-ace6-a6666abad205) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feaade22-11d3-4d0b-ace6-a6666abad205) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-673255274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69efcdd-5a26-4520-a447-3369931a204a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b006070bc92c49e7beff874f656a7cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:53:53Z,use_quota=True,user_id='610313d9106541e793c77472f2fdf73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289c7de2-b40d-4ddf-bc19-a04b21a8733e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (289c7de2-b40d-4ddf-bc19-a04b21a8733e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67cc881-25b9-4c83-8ae0-814816e29e79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:52 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c67cc881-25b9-4c83-8ae0-814816e29e79) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c69efcdd-5a26-4520-a447-3369931a204a', 'volume_name': 'volume-c69efcdd-5a26-4520-a447-3369931a204a', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06cc2b8-fb7c-4c96-98f9-c56d441db8f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c06cc2b8-fb7c-4c96-98f9-c56d441db8f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9506bc-e2e0-432e-99ce-fa841c0d6d7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:53:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Volume c69efcdd-5a26-4520-a447-3369931a204a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c69efcdd-5a26-4520-a447-3369931a204a', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Trying to clone c69efcdd-5a26-4520-a447-3369931a204a from image b9f83e66-733e-4378-86ef-e85be0416fc2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 11:53:53 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Image download 20.69 MB at 20.69 MB/s Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[86ccf26e-3f17-440f-87e7-91d503c124f8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:53:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:54 devstack sudo[91078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD Sep 03 11:53:54 devstack sudo[91078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:54 devstack sudo[91078]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD" returned: 0 in 0.382s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 is fetched for user 610313d9106541e793c77472f2fdf73a. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[21730152-9eb6-4ba8-a3e7-f486aed3564d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:54 devstack sudo[91084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD Sep 03 11:53:54 devstack sudo[91084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:54 devstack sudo[91084]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD" returned: 0 in 0.376s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:53:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-673255274',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c69efcdd-5a26-4520-a447-3369931a204a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b006070bc92c49e7beff874f656a7cbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:53:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:53:53Z,use_quota=True,user_id='610313d9106541e793c77472f2fdf73a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Creating volume c69efcdd-5a26-4520-a447-3369931a204a {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:53:54 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:53:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:54 devstack sudo[91089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a 1073741824 Sep 03 11:53:54 devstack sudo[91089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:55 devstack sudo[91089]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a 1073741824" returned: 0 in 0.521s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:55 devstack sudo[91095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a Sep 03 11:53:55 devstack sudo[91095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:55 devstack sudo[91095]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.830s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Attempting download of b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume c69efcdd-5a26-4520-a447-3369931a204a. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[63c331f0-5d7d-4ddb-844c-83003d9632a2]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:53:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_7eqfe5m9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:55 devstack sudo[91098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_7eqfe5m9 Sep 03 11:53:55 devstack sudo[91098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:56 devstack sudo[91098]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_7eqfe5m9" returned: 0 in 0.548s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_7eqfe5m9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:56 devstack sudo[91102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_7eqfe5m9 Sep 03 11:53:56 devstack sudo[91102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:56 devstack sudo[91102]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_7eqfe5m9" returned: 1 in 0.433s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_7eqfe5m9' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:53:56 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93b44bc-9561-4b0a-a7b5-abf0704d4185]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:53:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:56 devstack sudo[91106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD Sep 03 11:53:56 devstack sudo[91106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:57 devstack sudo[91106]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD" returned: 0 in 0.490s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:57 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] b9f83e66-733e-4378-86ef-e85be0416fc2 was qcow2, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 11:53:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:57 devstack sudo[91111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a Sep 03 11:53:57 devstack sudo[91111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:53:59 devstack sudo[91111]: pam_unix(sudo:session): session closed for user root Sep 03 11:53:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a" returned: 0 in 2.566s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:53:59 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_yu0m4lfzdevstack@QuobyteHD, size 112.00 MB, duration 2.57 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:53:59 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Converted 112.00 MB image at 43.63 MB/s Sep 03 11:53:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:53:59 devstack sudo[91122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a 1G Sep 03 11:53:59 devstack sudo[91122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:54:00 devstack sudo[91122]: pam_unix(sudo:session): session closed for user root Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a 1G" returned: 0 in 0.418s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Downloaded image b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume c69efcdd-5a26-4520-a447-3369931a204a successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 for user 610313d9106541e793c77472f2fdf73a is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Marking volume c69efcdd-5a26-4520-a447-3369931a204a as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Copying metadata from image b9f83e66-733e-4378-86ef-e85be0416fc2 to c69efcdd-5a26-4520-a447-3369931a204a. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Creating volume glance metadata for volume c69efcdd-5a26-4520-a447-3369931a204a backed by image b9f83e66-733e-4378-86ef-e85be0416fc2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d9506bc-e2e0-432e-99ce-fa841c0d6d7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c69efcdd-5a26-4520-a447-3369931a204a', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28cf64e-b420-48d9-88f8-21b11a3bd7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Volume volume-c69efcdd-5a26-4520-a447-3369931a204a (c69efcdd-5a26-4520-a447-3369931a204a): created successfully Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d28cf64e-b420-48d9-88f8-21b11a3bd7cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Flow 'volume_create_manager' (65addedc-01d0-4990-9d65-9ffe3de66254) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:54:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ad986952-dc31-40a6-aa37-38828ea59829 tempest-ServerActionsTestOtherA-1835155833 None] Created volume successfully. Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Flow 'volume_create_manager' (6302ba6c-7a03-4f47-9747-3bc54ea1b331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70629e7a-dbca-4e11-aa9d-46f866223dd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70629e7a-dbca-4e11-aa9d-46f866223dd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1391029008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb7c7b5-cc02-487e-9a1d-580f0681f2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ae91247cc54b75918cb927a1dc5a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:54:00Z,use_quota=True,user_id='06f33a2ef02a4aa3ad9f3e0d8d9a068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6f4f65-99e2-4078-bc6b-f69b166a31b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf6f4f65-99e2-4078-bc6b-f69b166a31b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cac176-ce3c-41b3-8066-23b047022f51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (56cac176-ce3c-41b3-8066-23b047022f51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcb7c7b5-cc02-487e-9a1d-580f0681f2a5', 'volume_name': 'volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070287d8-fc10-47d0-bb3f-89e696778eb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (070287d8-fc10-47d0-bb3f-89e696778eb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecebc5f-b384-4844-a3d3-4400c6cec081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Volume dcb7c7b5-cc02-487e-9a1d-580f0681f2a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5', 'volume_size': 1} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1391029008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcb7c7b5-cc02-487e-9a1d-580f0681f2a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ae91247cc54b75918cb927a1dc5a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:54:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:54:00Z,use_quota=True,user_id='06f33a2ef02a4aa3ad9f3e0d8d9a068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Creating volume dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:54:00 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:54:00 devstack sudo[91128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 1073741824 Sep 03 11:54:00 devstack sudo[91128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Flow 'volume_create_manager' (bbdf76c9-27db-427c-8e21-5b30391d114b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7c3e3c-8236-4e0b-93b3-601ad7162658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f7c3e3c-8236-4e0b-93b3-601ad7162658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-461396526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2287d7bb-8c7f-440d-82ea-46a14c059623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab01d948d1d4a58af5ac464c0a43140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:54:01Z,use_quota=True,user_id='5f53bc7883e744348a92ba2c96487afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1484e4b-b1a5-4b88-8243-f84130120a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1484e4b-b1a5-4b88-8243-f84130120a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126af577-64ca-4729-9c44-07d1cd7f8cdb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (126af577-64ca-4729-9c44-07d1cd7f8cdb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2287d7bb-8c7f-440d-82ea-46a14c059623', 'volume_name': 'volume-2287d7bb-8c7f-440d-82ea-46a14c059623', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae33bb53-bf9e-4bf2-acc5-6cff6fb7adb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae33bb53-bf9e-4bf2-acc5-6cff6fb7adb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f31973e-4bdc-4c27-b5f6-2cd8e4ae47ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Volume 2287d7bb-8c7f-440d-82ea-46a14c059623: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2287d7bb-8c7f-440d-82ea-46a14c059623', 'volume_size': 1} Sep 03 11:54:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:01 devstack sudo[91128]: pam_unix(sudo:session): session closed for user root Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 1073741824" returned: 0 in 0.535s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:54:01 devstack sudo[91134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 Sep 03 11:54:01 devstack sudo[91134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:54:01 devstack sudo[91134]: pam_unix(sudo:session): session closed for user root Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.507s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:54:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-461396526',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2287d7bb-8c7f-440d-82ea-46a14c059623,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fab01d948d1d4a58af5ac464c0a43140',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:54:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:54:01Z,use_quota=True,user_id='5f53bc7883e744348a92ba2c96487afe',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Creating volume 2287d7bb-8c7f-440d-82ea-46a14c059623 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:54:01 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ecebc5f-b384-4844-a3d3-4400c6cec081) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f76dc6b-37c9-489e-9951-4e0b5219084b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:01 devstack sudo[91137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 1073741824 Sep 03 11:54:01 devstack sudo[91137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:54:01 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Volume volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 (dcb7c7b5-cc02-487e-9a1d-580f0681f2a5): created successfully Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f76dc6b-37c9-489e-9951-4e0b5219084b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Flow 'volume_create_manager' (6302ba6c-7a03-4f47-9747-3bc54ea1b331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:54:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b54a89a6-034b-4483-9c91-794a1598eb93 tempest-AttachVolumeNegativeTest-1161512630 None] Created volume successfully. Sep 03 11:54:02 devstack sudo[91137]: pam_unix(sudo:session): session closed for user root Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 1073741824" returned: 0 in 0.542s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:54:02 devstack sudo[91146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 Sep 03 11:54:02 devstack sudo[91146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:54:02 devstack sudo[91146]: pam_unix(sudo:session): session closed for user root Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6f31973e-4bdc-4c27-b5f6-2cd8e4ae47ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2287d7bb-8c7f-440d-82ea-46a14c059623', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd07e63-8f05-47b9-8fec-3a2766e28e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:54:02 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Volume volume-2287d7bb-8c7f-440d-82ea-46a14c059623 (2287d7bb-8c7f-440d-82ea-46a14c059623): created successfully Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fd07e63-8f05-47b9-8fec-3a2766e28e08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:54:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Flow 'volume_create_manager' (bbdf76c9-27db-427c-8e21-5b30391d114b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:54:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-42cd4af0-68eb-4592-b854-1df8d81b7099 tempest-TaggedAttachmentsTest-1386651228 None] Created volume successfully. Sep 03 11:54:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-966fd6a4-ee30-48be-9c5e-2b0542700ddb req-fefe6afb-3215-4c64-a875-0fba1bb04ec0 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-966fd6a4-ee30-48be-9c5e-2b0542700ddb req-fefe6afb-3215-4c64-a875-0fba1bb04ec0 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-966fd6a4-ee30-48be-9c5e-2b0542700ddb req-fefe6afb-3215-4c64-a875-0fba1bb04ec0 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-966fd6a4-ee30-48be-9c5e-2b0542700ddb req-fefe6afb-3215-4c64-a875-0fba1bb04ec0 tempest-ServerActionsTestOtherA-1835155833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-c69efcdd-5a26-4520-a447-3369931a204a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b7a72ea8-d87f-472e-94e9-00616d6f1975', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:54:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-966fd6a4-ee30-48be-9c5e-2b0542700ddb req-fefe6afb-3215-4c64-a875-0fba1bb04ec0 tempest-ServerActionsTestOtherA-1835155833 None] attachment_update completed successfully. Sep 03 11:54:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-1c530aa0-157f-4512-88b3-e482da018825 req-2625b5fd-3ffa-43b5-97a4-e4457d544e1a tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-1c530aa0-157f-4512-88b3-e482da018825 req-2625b5fd-3ffa-43b5-97a4-e4457d544e1a tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-1c530aa0-157f-4512-88b3-e482da018825 req-2625b5fd-3ffa-43b5-97a4-e4457d544e1a tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-1c530aa0-157f-4512-88b3-e482da018825 req-2625b5fd-3ffa-43b5-97a4-e4457d544e1a tempest-AttachVolumeNegativeTest-1161512630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5905df72-a5e1-427d-b6ad-1c3838bbf8a4', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:54:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-1c530aa0-157f-4512-88b3-e482da018825 req-2625b5fd-3ffa-43b5-97a4-e4457d544e1a tempest-AttachVolumeNegativeTest-1161512630 None] attachment_update completed successfully. Sep 03 11:54:14 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=28,cinder:SELECT=43,cinder:INSERT=15,cinder:DELETE=7 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:54:14 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=40,cinder:UPDATE=43,cinder:INSERT=11 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:54:16 devstack sudo[91645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:54:16 devstack sudo[91645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:54:16 devstack sudo[91645]: pam_unix(sudo:session): session closed for user root Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.644s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:54:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:54:37 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-fe23370a-f852-4744-a369-bd8dd9204076 req-2f220c49-e0ec-47ee-99d5-5b3e3aaa3d9b tempest-ServerActionsTestOtherA-1835155833 None] Terminate volume connection completed successfully. Sep 03 11:54:37 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-fe23370a-f852-4744-a369-bd8dd9204076 req-2f220c49-e0ec-47ee-99d5-5b3e3aaa3d9b tempest-ServerActionsTestOtherA-1835155833 None] Deleting attachment b7a72ea8-d87f-472e-94e9-00616d6f1975. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:54:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-fe23370a-f852-4744-a369-bd8dd9204076 req-e415d448-7d9a-4d20-928c-cf222a60e146 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:54:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-fe23370a-f852-4744-a369-bd8dd9204076 req-e415d448-7d9a-4d20-928c-cf222a60e146 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:54:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-fe23370a-f852-4744-a369-bd8dd9204076 req-e415d448-7d9a-4d20-928c-cf222a60e146 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:54:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-fe23370a-f852-4744-a369-bd8dd9204076 req-e415d448-7d9a-4d20-928c-cf222a60e146 tempest-ServerActionsTestOtherA-1835155833 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-c69efcdd-5a26-4520-a447-3369931a204a', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '37027714-8264-4f46-9551-85e6fca89880', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:54:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-fe23370a-f852-4744-a369-bd8dd9204076 req-e415d448-7d9a-4d20-928c-cf222a60e146 tempest-ServerActionsTestOtherA-1835155833 None] attachment_update completed successfully. Sep 03 11:54:52 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:54:52 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=2,cinder:SELECT=8 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:55:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-7bc267e6-df72-4626-ae3f-e8fada3c837a req-24adf15f-2657-451d-b057-d92477c3e96d tempest-TaggedAttachmentsTest-1386651228 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-7bc267e6-df72-4626-ae3f-e8fada3c837a req-24adf15f-2657-451d-b057-d92477c3e96d tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-7bc267e6-df72-4626-ae3f-e8fada3c837a req-24adf15f-2657-451d-b057-d92477c3e96d tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-7bc267e6-df72-4626-ae3f-e8fada3c837a req-24adf15f-2657-451d-b057-d92477c3e96d tempest-TaggedAttachmentsTest-1386651228 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-2287d7bb-8c7f-440d-82ea-46a14c059623', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eab23faa-e9e8-4cea-9cfa-6f31bb52e31e', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:55:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-7bc267e6-df72-4626-ae3f-e8fada3c837a req-24adf15f-2657-451d-b057-d92477c3e96d tempest-TaggedAttachmentsTest-1386651228 None] attachment_update completed successfully. Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Flow 'volume_create_manager' (f6cfc0f1-8fc7-42b0-ae58-8a634c271b11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5b5465-f72b-4e6c-ac92-d7b8b148bf7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd5b5465-f72b-4e6c-ac92-d7b8b148bf7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2135909269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724eb31f-8331-4468-8752-bf3c8de077e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc424b332cca44f193d2fe904413c7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:55:06Z,use_quota=True,user_id='280ba1de5b8743229b2ac708f3882327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6808b2e6-154e-44dd-80b4-3e7a4ee406b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6808b2e6-154e-44dd-80b4-3e7a4ee406b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69004d7-30de-4196-aae1-afbf002b6a35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d69004d7-30de-4196-aae1-afbf002b6a35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '724eb31f-8331-4468-8752-bf3c8de077e3', 'volume_name': 'volume-724eb31f-8331-4468-8752-bf3c8de077e3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e559ea2d-fbe6-41cf-b105-0c0ac1d6fda1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e559ea2d-fbe6-41cf-b105-0c0ac1d6fda1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097d7f90-66f3-4872-84d6-9ca98b23fa22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:05 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Volume 724eb31f-8331-4468-8752-bf3c8de077e3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-724eb31f-8331-4468-8752-bf3c8de077e3', 'volume_size': 1} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:55:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2135909269',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=724eb31f-8331-4468-8752-bf3c8de077e3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc424b332cca44f193d2fe904413c7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:55:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:55:06Z,use_quota=True,user_id='280ba1de5b8743229b2ac708f3882327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Creating volume 724eb31f-8331-4468-8752-bf3c8de077e3 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:55:05 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:05 devstack sudo[92632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 1073741824 Sep 03 11:55:05 devstack sudo[92632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-c7e95874-d02f-443b-9ce9-c86cbba7e3ad req-1760f290-9222-4264-b5d4-f4ce862d772c tempest-TaggedAttachmentsTest-1386651228 None] Terminate volume connection completed successfully. Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-c7e95874-d02f-443b-9ce9-c86cbba7e3ad req-1760f290-9222-4264-b5d4-f4ce862d772c tempest-TaggedAttachmentsTest-1386651228 None] Deleting attachment eab23faa-e9e8-4cea-9cfa-6f31bb52e31e. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:55:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-ee8b581a-f92e-4a05-aee5-d223f615174c req-74c08ac2-0200-4933-8b72-a333b53e1123 tempest-AttachVolumeNegativeTest-1161512630 None] Terminate volume connection completed successfully. Sep 03 11:55:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-ee8b581a-f92e-4a05-aee5-d223f615174c req-74c08ac2-0200-4933-8b72-a333b53e1123 tempest-AttachVolumeNegativeTest-1161512630 None] Deleting attachment 5905df72-a5e1-427d-b6ad-1c3838bbf8a4. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:55:06 devstack sudo[92632]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 1073741824" returned: 0 in 0.474s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:06 devstack sudo[92641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 Sep 03 11:55:06 devstack sudo[92641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:06 devstack sudo[92641]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3" returned: 0 in 0.264s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] <== create_volume: return (775ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.780s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (097d7f90-66f3-4872-84d6-9ca98b23fa22) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-724eb31f-8331-4468-8752-bf3c8de077e3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5592ef96-8dca-4c75-9493-774475953db7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:06 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Volume volume-724eb31f-8331-4468-8752-bf3c8de077e3 (724eb31f-8331-4468-8752-bf3c8de077e3): created successfully Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5592ef96-8dca-4c75-9493-774475953db7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Flow 'volume_create_manager' (f6cfc0f1-8fc7-42b0-ae58-8a634c271b11) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:55:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e4cf740d-f4ad-4e8a-a634-12326e973148 tempest-AttachVolumeTestJSON-1352568732 None] Created volume successfully. Sep 03 11:55:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-2eb4f25f-9f97-4c09-a5e5-f6af9e7a5390 req-bf70ca59-09f7-46b4-a175-74dcb794f687 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-2eb4f25f-9f97-4c09-a5e5-f6af9e7a5390 req-bf70ca59-09f7-46b4-a175-74dcb794f687 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-2eb4f25f-9f97-4c09-a5e5-f6af9e7a5390 req-bf70ca59-09f7-46b4-a175-74dcb794f687 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-2eb4f25f-9f97-4c09-a5e5-f6af9e7a5390 req-bf70ca59-09f7-46b4-a175-74dcb794f687 tempest-AttachVolumeTestJSON-1352568732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-724eb31f-8331-4468-8752-bf3c8de077e3', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7b537a95-277d-47ac-8cbb-a23af9e8f19b', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:55:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-2eb4f25f-9f97-4c09-a5e5-f6af9e7a5390 req-bf70ca59-09f7-46b4-a175-74dcb794f687 tempest-AttachVolumeTestJSON-1352568732 None] attachment_update completed successfully. Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:16 devstack sudo[92944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:55:16 devstack sudo[92944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:16 devstack sudo[92944]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.612s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:55:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:55:18 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=15,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:55:18 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=19,cinder:UPDATE=4,cinder:INSERT=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:55:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-b5a788ea-e0d7-4659-a65b-280382d68ea1 tempest-ServerActionsTestOtherA-1835155833 None] Terminate volume connection completed successfully. Sep 03 11:55:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-b5a788ea-e0d7-4659-a65b-280382d68ea1 tempest-ServerActionsTestOtherA-1835155833 None] Deleting attachment 37027714-8264-4f46-9551-85e6fca89880. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:55:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "cinder-c69efcdd-5a26-4520-a447-3369931a204a-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-c69efcdd-5a26-4520-a447-3369931a204a-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "cinder-quobyte-c69efcdd-5a26-4520-a447-3369931a204a" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-quobyte-c69efcdd-5a26-4520-a447-3369931a204a" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0ab39b4-ec00-4405-af54-6f9e7748df1c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:55:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:19 devstack sudo[92992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a Sep 03 11:55:19 devstack sudo[92992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:20 devstack sudo[92992]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a" returned: 0 in 0.568s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:20 devstack sudo[92998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a Sep 03 11:55:20 devstack sudo[92998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:20 devstack sudo[92998]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c69efcdd-5a26-4520-a447-3369931a204a" returned: 0 in 0.457s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-quobyte-c69efcdd-5a26-4520-a447-3369931a204a" released by "delete_volume" :: held 1.094s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.quota [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Created reservations ['8eb74e38-21f3-4334-a730-4a8fd7a173e3', 'fb282848-f9e7-4992-b0d1-a676b6f991d4', 'ec58a8a9-a5e1-4553-bee7-5c5a354a8e4f', '6aa97183-f34f-4b73-a1f2-9d977327d12c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Acquiring lock "cinder-2287d7bb-8c7f-440d-82ea-46a14c059623-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:20 devstack sudo[93004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:55:20 devstack sudo[93004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Lock "cinder-2287d7bb-8c7f-440d-82ea-46a14c059623-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "cinder-fd282923-43bf-46f6-a462-1de7347895e0-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-fd282923-43bf-46f6-a462-1de7347895e0-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Acquiring lock "cinder-quobyte-2287d7bb-8c7f-440d-82ea-46a14c059623" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Lock "cinder-quobyte-2287d7bb-8c7f-440d-82ea-46a14c059623" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:21 devstack sudo[93004]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.417s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG cinder.manager [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:55:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Deleted volume successfully. Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[318dccf2-3591-4afe-a80a-837f190e19a1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-47e17faf-1d3a-4bc1-b474-959e2277d932 req-ec14a922-4f45-4e81-b1e6-2dd36c56f5b5 tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-c69efcdd-5a26-4520-a447-3369931a204a-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "cinder-quobyte-fd282923-43bf-46f6-a462-1de7347895e0" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-quobyte-fd282923-43bf-46f6-a462-1de7347895e0" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[01a873ad-e34c-4015-b5f9-78ca68d74999]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:21 devstack sudo[93010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 Sep 03 11:55:21 devstack sudo[93010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:21 devstack sudo[93011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 Sep 03 11:55:21 devstack sudo[93011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:21 devstack sudo[93010]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623" returned: 0 in 0.509s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:21 devstack sudo[93020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623 Sep 03 11:55:21 devstack sudo[93020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:21 devstack sudo[93011]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0" returned: 0 in 0.488s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:21 devstack sudo[93023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0 Sep 03 11:55:21 devstack sudo[93023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:22 devstack sudo[93020]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2287d7bb-8c7f-440d-82ea-46a14c059623" returned: 0 in 0.317s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Lock "cinder-quobyte-2287d7bb-8c7f-440d-82ea-46a14c059623" released by "delete_volume" :: held 0.903s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:22 devstack sudo[93023]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd282923-43bf-46f6-a462-1de7347895e0" returned: 0 in 0.361s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-quobyte-fd282923-43bf-46f6-a462-1de7347895e0" released by "delete_volume" :: held 0.933s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Created reservations ['4ce1caee-499b-4636-b9f0-e7c29fb51d0a', 'a558e8dd-5c06-4dc5-99fa-a3c57b96ed7d', '68ca31da-4229-4cd5-9897-9e5f3971321b', 'b58ce926-035b-4e11-b7d4-0a7f6a079433'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Created reservations ['417df88e-1042-4e0f-b30a-edd7ff8bdb04', '5bbe8562-6d76-4732-b552-b3105c110024', '878adfd9-196d-4bd7-aed1-a40c7e8ec2c5', '03b2b451-d3d8-4872-9507-119ebedcf8a4'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:22 devstack sudo[93027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:55:22 devstack sudo[93027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:22 devstack sudo[93029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:55:22 devstack sudo[93029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:22 devstack sudo[93027]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.414s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:55:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Deleted volume successfully. Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ebd0d153-7534-4018-bcb3-e6c809df94c9 tempest-TaggedAttachmentsTest-1386651228 None] Lock "cinder-2287d7bb-8c7f-440d-82ea-46a14c059623-delete_volume" released by "delete_volume" :: held 1.992s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:22 devstack sudo[93029]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.477s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:55:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Deleted volume successfully. Sep 03 11:55:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c355ab3c-ac2c-4818-ad10-0da8ec08d69e tempest-ServerActionsTestOtherA-1835155833 None] Lock "cinder-fd282923-43bf-46f6-a462-1de7347895e0-delete_volume" released by "delete_volume" :: held 1.993s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:32 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=23,cinder:INSERT=8,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:55:32 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=9,cinder:UPDATE=29,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Flow 'volume_create_manager' (12194e7c-328a-4206-ad38-07d0deff59b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a642b7-5deb-4381-9fd1-177d26930c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a642b7-5deb-4381-9fd1-177d26930c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-434693713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad675ad8-e1dc-4294-b5b4-ba74ead823ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be0d76d7fd54024ba3405622df99e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:55:42Z,use_quota=True,user_id='399134d1c4a74262ab97b26d62d750c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9190e449-c03f-4407-ac17-06692ffac292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9190e449-c03f-4407-ac17-06692ffac292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f87733-567f-40d6-9f01-d456545d98b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30f87733-567f-40d6-9f01-d456545d98b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad675ad8-e1dc-4294-b5b4-ba74ead823ff', 'volume_name': 'volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8317df5-79a8-4f44-ac85-74ddaeb1990b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b8317df5-79a8-4f44-ac85-74ddaeb1990b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d637de-e925-407f-a026-f7b54e419eed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:41 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Volume ad675ad8-e1dc-4294-b5b4-ba74ead823ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff', 'volume_size': 1} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:55:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-434693713',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad675ad8-e1dc-4294-b5b4-ba74ead823ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6be0d76d7fd54024ba3405622df99e07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:55:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:55:42Z,use_quota=True,user_id='399134d1c4a74262ab97b26d62d750c1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Creating volume ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:55:41 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:55:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:41 devstack sudo[93206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff 1073741824 Sep 03 11:55:41 devstack sudo[93206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:42 devstack sudo[93206]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff 1073741824" returned: 0 in 0.611s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:42 devstack sudo[93222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff Sep 03 11:55:42 devstack sudo[93222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-cf3f57b8-b47f-4756-a87a-2224af7df15d req-9a7cde92-630b-45b2-a9ad-629eafd19c5e tempest-AttachVolumeTestJSON-1352568732 None] Terminate volume connection completed successfully. Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-cf3f57b8-b47f-4756-a87a-2224af7df15d req-9a7cde92-630b-45b2-a9ad-629eafd19c5e tempest-AttachVolumeTestJSON-1352568732 None] Deleting attachment 7b537a95-277d-47ac-8cbb-a23af9e8f19b. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:55:42 devstack sudo[93222]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" returned: 0 in 0.387s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.067s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (31d637de-e925-407f-a026-f7b54e419eed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9418cf-8952-4d0a-b0cb-0e7a26e461fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:42 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Volume volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff (ad675ad8-e1dc-4294-b5b4-ba74ead823ff): created successfully Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b9418cf-8952-4d0a-b0cb-0e7a26e461fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Flow 'volume_create_manager' (12194e7c-328a-4206-ad38-07d0deff59b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:55:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-899f22be-baad-47e3-b715-9d7cf0e14769 req-aad47e06-58d8-4675-82e4-666595ebafed tempest-VolumesSnapshotsTestJSON-1058699329 None] Created volume successfully. Sep 03 11:55:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Creating offline snapshot 34d7203a-701e-4919-aa7d-657c2cae8bc7 of volume ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:55:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2457c778-5de1-411f-a869-b7e79e224c1b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:55:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:44 devstack sudo[93232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff Sep 03 11:55:44 devstack sudo[93232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:44 devstack sudo[93232]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" returned: 0 in 0.407s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:44 devstack sudo[93237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 1G Sep 03 11:55:44 devstack sudo[93237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:45 devstack sudo[93237]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 1G" returned: 0 in 0.532s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:45 devstack sudo[93244]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 Sep 03 11:55:45 devstack sudo[93244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:45 devstack sudo[93244]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7" returned: 0 in 0.299s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:45 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 is being set with open permissions: ugo+rw Sep 03 11:55:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:45 devstack sudo[93250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 Sep 03 11:55:45 devstack sudo[93250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:45 devstack sudo[93250]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7" returned: 0 in 0.304s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:45 devstack sudo[93254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.info Sep 03 11:55:45 devstack sudo[93254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:46 devstack sudo[93254]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.info" returned: 0 in 0.474s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:46 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.info is being set with open permissions: ugo+rw Sep 03 11:55:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:46 devstack sudo[93274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.info Sep 03 11:55:46 devstack sudo[93274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:46 devstack sudo[93274]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.info" returned: 0 in 0.398s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.524s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-a6e1d4fe-95da-4bfc-9e59-01338f73a1f8 req-b0a1da30-720a-4a01-87e7-67c872b9eb9f tempest-VolumesSnapshotsTestJSON-1058699329 None] Create snapshot completed successfully Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "cinder-34d7203a-701e-4919-aa7d-657c2cae8bc7-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-34d7203a-701e-4919-aa7d-657c2cae8bc7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "cinder-quobyte-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-quobyte-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "cinder-quobyte-34d7203a-701e-4919-aa7d-657c2cae8bc7" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-quobyte-34d7203a-701e-4919-aa7d-657c2cae8bc7" acquired by "_delete_snapshot" :: waited 0.046s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Deleting offline snapshot 34d7203a-701e-4919-aa7d-657c2cae8bc7 of volume ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] snapshot_file for this snap is: volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ccfea5f-4ebb-4319-b92e-658ed9dc6d2c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:48 devstack sudo[93353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 Sep 03 11:55:48 devstack sudo[93353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:48 devstack sudo[93353]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7" returned: 0 in 0.621s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[17868a40-f55c-4420-949c-8eda05bcf2c1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:55:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:49 devstack sudo[93361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff Sep 03 11:55:49 devstack sudo[93361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:49 devstack sudo[93361]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" returned: 0 in 0.650s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:49 devstack sudo[93366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 Sep 03 11:55:49 devstack sudo[93366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:50 devstack sudo[93366]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7" returned: 0 in 0.534s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:50 devstack sudo[93372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7 Sep 03 11:55:50 devstack sudo[93372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:50 devstack sudo[93372]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff.34d7203a-701e-4919-aa7d-657c2cae8bc7" returned: 0 in 0.460s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-quobyte-34d7203a-701e-4919-aa7d-657c2cae8bc7" released by "_delete_snapshot" :: held 2.507s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-quobyte-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" released by "delete_snapshot" :: held 2.566s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:50 devstack cinder-volume[87256]: WARNING cinder.quota [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:55:50 devstack cinder-volume[87256]: DEBUG cinder.quota [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Created reservations ['50ef1f2f-3d12-4024-8688-362dd0122bb1', '93f3bd1a-aa72-4a4b-ad17-dcd4414c2eda', 'e0900c7d-9833-4ab8-9286-f7d12aa2c8a7', '85c2dc9e-1b12-4d45-8d34-b6cbbceeb2ee'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:55:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Delete snapshot completed successfully. Sep 03 11:55:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-35a1759a-193a-4dd9-ba12-b2bce865d58b req-5e890c2d-a13b-440a-98b0-6bf87c8f956d tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-34d7203a-701e-4919-aa7d-657c2cae8bc7-delete_snapshot" released by "delete_snapshot" :: held 2.840s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "cinder-ad675ad8-e1dc-4294-b5b4-ba74ead823ff-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-ad675ad8-e1dc-4294-b5b4-ba74ead823ff-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "cinder-quobyte-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:55:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-quobyte-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:55:51 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c11c0ae-caec-4ef9-93dd-00c9a184e863]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:55:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:52 devstack sudo[93377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff Sep 03 11:55:52 devstack sudo[93377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:52 devstack sudo[93377]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" returned: 0 in 0.619s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:52 devstack sudo[93384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff Sep 03 11:55:52 devstack sudo[93384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:53 devstack sudo[93384]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" returned: 0 in 0.596s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-quobyte-ad675ad8-e1dc-4294-b5b4-ba74ead823ff" released by "delete_volume" :: held 1.304s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.quota [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Created reservations ['f9692d12-1669-43ad-b969-28fca567843a', 'e8dd9430-a99d-4281-a39c-290ec5212b42', '9b761f64-e9bd-406f-afaf-99ca6a760c84', 'f0216d3f-d1a6-4235-8d7c-af59d09c26cd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Flow 'volume_create_manager' (c03aea1b-0a51-4b61-aea4-d418abf6b179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cae015-56bd-464c-913b-8c4269ee0ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61cae015-56bd-464c-913b-8c4269ee0ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1642904224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc5071a-9bf8-4921-9fcd-d2f35a509971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ae91247cc54b75918cb927a1dc5a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:55:53Z,use_quota=True,user_id='06f33a2ef02a4aa3ad9f3e0d8d9a068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cbc9ca-25c9-494c-b771-2061cf053334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (27cbc9ca-25c9-494c-b771-2061cf053334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bb0dbc-8767-4d96-b9f9-3a9785f29253) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d1bb0dbc-8767-4d96-b9f9-3a9785f29253) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4dc5071a-9bf8-4921-9fcd-d2f35a509971', 'volume_name': 'volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0385c2a-2c76-47e0-af19-5ba00ef795df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0385c2a-2c76-47e0-af19-5ba00ef795df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3c9afd-bd9a-4ec0-a98a-b63ee18512ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Volume 4dc5071a-9bf8-4921-9fcd-d2f35a509971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971', 'volume_size': 1} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:55:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1642904224',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dc5071a-9bf8-4921-9fcd-d2f35a509971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ae91247cc54b75918cb927a1dc5a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:55:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:55:53Z,use_quota=True,user_id='06f33a2ef02a4aa3ad9f3e0d8d9a068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Creating volume 4dc5071a-9bf8-4921-9fcd-d2f35a509971 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:55:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:53 devstack sudo[93388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 1073741824 Sep 03 11:55:53 devstack sudo[93388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:53 devstack sudo[93390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:55:53 devstack sudo[93390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:53 devstack sudo[93390]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.manager [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:55:53 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Deleted volume successfully. Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-42c7aa97-7416-423a-aac5-e6d5268af0da req-9ccc9d48-a044-4cbc-83e2-46652e29cee0 tempest-VolumesSnapshotsTestJSON-1058699329 None] Lock "cinder-ad675ad8-e1dc-4294-b5b4-ba74ead823ff-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:55:53 devstack sudo[93388]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 1073741824" returned: 0 in 0.515s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:55:54 devstack sudo[93397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 Sep 03 11:55:54 devstack sudo[93397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:55:54 devstack sudo[93397]: pam_unix(sudo:session): session closed for user root Sep 03 11:55:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:55:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] <== create_volume: return (847ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:55:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d3c9afd-bd9a-4ec0-a98a-b63ee18512ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7aa0ef-3113-4eee-8061-66981fe08c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:55:54 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Volume volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 (4dc5071a-9bf8-4921-9fcd-d2f35a509971): created successfully Sep 03 11:55:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc7aa0ef-3113-4eee-8061-66981fe08c34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:55:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Flow 'volume_create_manager' (c03aea1b-0a51-4b61-aea4-d418abf6b179) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:55:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3cd7039d-57fb-4f82-be4e-958dafe208f3 tempest-AttachVolumeNegativeTest-1161512630 None] Created volume successfully. Sep 03 11:55:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-9921d49c-c013-447a-9444-e263f1c59bfc req-f0ce379f-02dd-4b27-8ee6-0abf079d6592 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:55:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-9921d49c-c013-447a-9444-e263f1c59bfc req-f0ce379f-02dd-4b27-8ee6-0abf079d6592 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:55:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-9921d49c-c013-447a-9444-e263f1c59bfc req-f0ce379f-02dd-4b27-8ee6-0abf079d6592 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:55:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-9921d49c-c013-447a-9444-e263f1c59bfc req-f0ce379f-02dd-4b27-8ee6-0abf079d6592 tempest-AttachVolumeNegativeTest-1161512630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5f3e9b84-d26f-4819-b564-eb2bf3c5d30b', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:55:56 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-9921d49c-c013-447a-9444-e263f1c59bfc req-f0ce379f-02dd-4b27-8ee6-0abf079d6592 tempest-AttachVolumeNegativeTest-1161512630 None] attachment_update completed successfully. Sep 03 11:55:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-3af62483-1644-41eb-b5c7-f0962e94059e req-3f00123c-c4d2-456e-bed6-5ff403c1ad85 tempest-AttachVolumeNegativeTest-1161512630 None] Terminate volume connection completed successfully. Sep 03 11:55:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-3af62483-1644-41eb-b5c7-f0962e94059e req-3f00123c-c4d2-456e-bed6-5ff403c1ad85 tempest-AttachVolumeNegativeTest-1161512630 None] Deleting attachment 5f3e9b84-d26f-4819-b564-eb2bf3c5d30b. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:56:09 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=28,cinder:UPDATE=23,cinder:INSERT=7,cinder:DELETE=2 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:56:09 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=25,cinder:UPDATE=22,cinder:INSERT=4,cinder:DELETE=2 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Flow 'volume_create_manager' (b40b6bf5-2000-4e1d-99c0-14cb7c3c627b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6637ba-3f8f-47d1-bc6c-2bd82c62217b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a6637ba-3f8f-47d1-bc6c-2bd82c62217b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-401594593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebe8c7e-1c3b-4635-b3f7-515a8701c703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680cac5dd8674a49a081debdcdc9832b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:10Z,use_quota=True,user_id='7d0bd15d9df34799b40c1f1449ff9d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513cddb7-4d0b-4d32-8558-394b364407d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (513cddb7-4d0b-4d32-8558-394b364407d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f94711-03e7-4104-8c2d-dd338cb87816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (32f94711-03e7-4104-8c2d-dd338cb87816) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aebe8c7e-1c3b-4635-b3f7-515a8701c703', 'volume_name': 'volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c1ba32-958e-4d99-8819-14940c39dfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1c1ba32-958e-4d99-8819-14940c39dfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bde06ff-431e-44f6-aa84-d08b038d789a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:10 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Volume aebe8c7e-1c3b-4635-b3f7-515a8701c703: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703', 'volume_size': 1} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-401594593',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aebe8c7e-1c3b-4635-b3f7-515a8701c703,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='680cac5dd8674a49a081debdcdc9832b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:10Z,use_quota=True,user_id='7d0bd15d9df34799b40c1f1449ff9d9a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Creating volume aebe8c7e-1c3b-4635-b3f7-515a8701c703 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:10 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:10 devstack sudo[93945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 1073741824 Sep 03 11:56:10 devstack sudo[93945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:11 devstack sudo[93945]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 1073741824" returned: 0 in 0.946s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:11 devstack sudo[93956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 Sep 03 11:56:11 devstack sudo[93956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:12 devstack sudo[93956]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703" returned: 0 in 0.726s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] <== create_volume: return (1769ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.785s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bde06ff-431e-44f6-aa84-d08b038d789a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa955cd0-21fa-46c0-901a-42f35881fdcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:12 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Volume volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 (aebe8c7e-1c3b-4635-b3f7-515a8701c703): created successfully Sep 03 11:56:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa955cd0-21fa-46c0-901a-42f35881fdcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Flow 'volume_create_manager' (b40b6bf5-2000-4e1d-99c0-14cb7c3c627b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:12 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7389ccfd-39d1-40ff-b48e-9336cb4b47eb tempest-VolumesServicesTestJSON-724560382 None] Created volume successfully. Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Acquiring lock "cinder-aebe8c7e-1c3b-4635-b3f7-515a8701c703-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Lock "cinder-aebe8c7e-1c3b-4635-b3f7-515a8701c703-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Acquiring lock "cinder-quobyte-aebe8c7e-1c3b-4635-b3f7-515a8701c703" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Lock "cinder-quobyte-aebe8c7e-1c3b-4635-b3f7-515a8701c703" acquired by "delete_volume" :: waited 0.048s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a25937-6682-441a-bf3a-93221d09f506]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:13 devstack sudo[93982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 Sep 03 11:56:13 devstack sudo[93982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:13 devstack sudo[93982]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703" returned: 0 in 0.653s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:14 devstack sudo[93995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703 Sep 03 11:56:14 devstack sudo[93995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:14 devstack sudo[93995]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aebe8c7e-1c3b-4635-b3f7-515a8701c703" returned: 0 in 0.537s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Lock "cinder-quobyte-aebe8c7e-1c3b-4635-b3f7-515a8701c703" released by "delete_volume" :: held 1.282s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Created reservations ['4a400a3e-b692-4e89-8dd5-aeab5b020bf4', '9cbef013-3c3c-40ed-b635-9300248d445f', '03dcc01b-e650-4425-9418-e74e6a4adce1', '1690aebc-a169-4dc4-ac2f-229b7208fd68'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:14 devstack sudo[94009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:56:14 devstack sudo[94009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:15 devstack sudo[94009]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.616s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:15 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:56:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Deleted volume successfully. Sep 03 11:56:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-084ebe5b-2f1e-462a-83a9-b1336a1e5e14 tempest-VolumesServicesTestJSON-724560382 None] Lock "cinder-aebe8c7e-1c3b-4635-b3f7-515a8701c703-delete_volume" released by "delete_volume" :: held 2.379s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:16 devstack sudo[94012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:56:16 devstack sudo[94012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:16 devstack sudo[94012]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.522s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:56:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:DELETE=1,cinder:INSERT=2 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Flow 'volume_create_manager' (564e933b-2870-4628-9aa5-7368c861d31c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41066292-66d3-40ee-82ca-123b6e97decc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41066292-66d3-40ee-82ca-123b6e97decc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2048369003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b83178-ee2b-4e50-88e8-0e204387cffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e605573b434b7d9b2d7cf3601d1d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:25Z,use_quota=True,user_id='d036870a24d84d9eb7fb876c982dc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530f6b56-b4a5-4e4e-bb0b-b2bf2294c334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (530f6b56-b4a5-4e4e-bb0b-b2bf2294c334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f55192-39e6-4e3f-ad1f-2a847a2e4ca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6f55192-39e6-4e3f-ad1f-2a847a2e4ca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '72b83178-ee2b-4e50-88e8-0e204387cffc', 'volume_name': 'volume-72b83178-ee2b-4e50-88e8-0e204387cffc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6907ba75-446c-4fdd-9c16-e3d37fd45cfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6907ba75-446c-4fdd-9c16-e3d37fd45cfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9ba0a4-9242-4af4-b3fe-9147708bab68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Volume 72b83178-ee2b-4e50-88e8-0e204387cffc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-72b83178-ee2b-4e50-88e8-0e204387cffc', 'volume_size': 1} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-2048369003',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=72b83178-ee2b-4e50-88e8-0e204387cffc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e605573b434b7d9b2d7cf3601d1d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:25Z,use_quota=True,user_id='d036870a24d84d9eb7fb876c982dc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Creating volume 72b83178-ee2b-4e50-88e8-0e204387cffc {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:25 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:25 devstack sudo[94161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc 1073741824 Sep 03 11:56:25 devstack sudo[94161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:25 devstack sudo[94161]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc 1073741824" returned: 0 in 0.576s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:25 devstack sudo[94168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc Sep 03 11:56:25 devstack sudo[94168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:25 devstack sudo[94168]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc" returned: 0 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] <== create_volume: return (972ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba9ba0a4-9242-4af4-b3fe-9147708bab68) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-72b83178-ee2b-4e50-88e8-0e204387cffc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777ac6e1-a6bb-468c-a87a-efd621a8acc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Volume volume-72b83178-ee2b-4e50-88e8-0e204387cffc (72b83178-ee2b-4e50-88e8-0e204387cffc): created successfully Sep 03 11:56:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (777ac6e1-a6bb-468c-a87a-efd621a8acc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Flow 'volume_create_manager' (564e933b-2870-4628-9aa5-7368c861d31c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-aa470b19-5fc8-4020-9ce1-91c61799855b tempest-VolumesListAdminTestJSON-1897411468 None] Created volume successfully. Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Flow 'volume_create_manager' (83e5f2c1-f30a-4f3d-83c1-a4d88cbb6aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc9b6e4-be2b-44c2-b86f-178dbe096115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bc9b6e4-be2b-44c2-b86f-178dbe096115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-182159146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30174a1-fb32-4c59-865a-152b0b2a95fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e605573b434b7d9b2d7cf3601d1d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:28Z,use_quota=True,user_id='d036870a24d84d9eb7fb876c982dc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e31cda-5265-48c8-af13-c48dcb25bfb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e31cda-5265-48c8-af13-c48dcb25bfb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7469e014-b15d-4968-8649-e5adec3cf074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7469e014-b15d-4968-8649-e5adec3cf074) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e30174a1-fb32-4c59-865a-152b0b2a95fc', 'volume_name': 'volume-e30174a1-fb32-4c59-865a-152b0b2a95fc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa25107-7c26-4112-9517-1cdf05c9faae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9aa25107-7c26-4112-9517-1cdf05c9faae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec9050e-831e-4df3-9228-4fe4044e6585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:27 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Volume e30174a1-fb32-4c59-865a-152b0b2a95fc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e30174a1-fb32-4c59-865a-152b0b2a95fc', 'volume_size': 1} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-182159146',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e30174a1-fb32-4c59-865a-152b0b2a95fc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e605573b434b7d9b2d7cf3601d1d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:28Z,use_quota=True,user_id='d036870a24d84d9eb7fb876c982dc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Creating volume e30174a1-fb32-4c59-865a-152b0b2a95fc {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:27 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:27 devstack sudo[94186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc 1073741824 Sep 03 11:56:27 devstack sudo[94186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:28 devstack sudo[94186]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc 1073741824" returned: 0 in 0.692s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:28 devstack sudo[94192]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc Sep 03 11:56:28 devstack sudo[94192]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:28 devstack sudo[94192]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc" returned: 0 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] <== create_volume: return (1139ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.142s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cec9050e-831e-4df3-9228-4fe4044e6585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e30174a1-fb32-4c59-865a-152b0b2a95fc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44375dcc-a065-427b-b4f4-0f6b87f4501b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Volume volume-e30174a1-fb32-4c59-865a-152b0b2a95fc (e30174a1-fb32-4c59-865a-152b0b2a95fc): created successfully Sep 03 11:56:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44375dcc-a065-427b-b4f4-0f6b87f4501b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Flow 'volume_create_manager' (83e5f2c1-f30a-4f3d-83c1-a4d88cbb6aa6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-70fc3a8a-eb87-4d15-a098-7cef74ae5c9a tempest-VolumesListAdminTestJSON-1897411468 None] Created volume successfully. Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Flow 'volume_create_manager' (e8c993fb-62d1-427a-9c68-525ffb440928) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cfa63c-bad0-43f9-b9c5-fcce20736da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (85cfa63c-bad0-43f9-b9c5-fcce20736da9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1527774085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bf18c5-5fef-4cc5-88f2-4cd08f6fd351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e605573b434b7d9b2d7cf3601d1d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:31Z,use_quota=True,user_id='d036870a24d84d9eb7fb876c982dc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f27425-af6a-408a-ba08-d88db0edfce2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (41f27425-af6a-408a-ba08-d88db0edfce2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb4d3e5-0c26-4151-9df0-b052cf342437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bcb4d3e5-0c26-4151-9df0-b052cf342437) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45bf18c5-5fef-4cc5-88f2-4cd08f6fd351', 'volume_name': 'volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59195d58-48b9-427b-91e8-ff76d5549076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (59195d58-48b9-427b-91e8-ff76d5549076) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580d7997-e2cb-40b3-9268-baa0756de619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:31 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Volume 45bf18c5-5fef-4cc5-88f2-4cd08f6fd351: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351', 'volume_size': 1} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1527774085',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45bf18c5-5fef-4cc5-88f2-4cd08f6fd351,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='72e605573b434b7d9b2d7cf3601d1d14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:31Z,use_quota=True,user_id='d036870a24d84d9eb7fb876c982dc0be',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Creating volume 45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:31 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:31 devstack sudo[94268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 1073741824 Sep 03 11:56:31 devstack sudo[94268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:32 devstack sudo[94268]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 1073741824" returned: 0 in 1.307s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:32 devstack sudo[94285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 Sep 03 11:56:32 devstack sudo[94285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:32 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Flow 'volume_create_manager' (14551442-0ec5-4ba9-8147-14874089fe71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cabc30e-013a-4240-919c-4fe38ced01b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2cabc30e-013a-4240-919c-4fe38ced01b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1214919039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c7bc52-339c-41f3-a87d-f2e4bd4044c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecd389051a148f18cc524877523ee42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:33Z,use_quota=True,user_id='e05891b8b2e6423cb51270ce5924dc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04120d36-3709-4314-a260-ec335ccdec6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (04120d36-3709-4314-a260-ec335ccdec6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd6e52d-c064-4d93-8660-7f499254767a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3fd6e52d-c064-4d93-8660-7f499254767a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd7c7bc52-339c-41f3-a87d-f2e4bd4044c4', 'volume_name': 'volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ffac39-9529-4e1f-ad78-d3b8b9781dc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ffac39-9529-4e1f-ad78-d3b8b9781dc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d31577-2edc-4f46-b223-3bbc74d834bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:33 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Volume d7c7bc52-339c-41f3-a87d-f2e4bd4044c4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4', 'volume_size': 1} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:33 devstack sudo[94285]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351" returned: 0 in 0.430s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] <== create_volume: return (1849ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.857s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.144s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1214919039',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d7c7bc52-339c-41f3-a87d-f2e4bd4044c4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eecd389051a148f18cc524877523ee42',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:33Z,use_quota=True,user_id='e05891b8b2e6423cb51270ce5924dc78',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Creating volume d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:33 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (580d7997-e2cb-40b3-9268-baa0756de619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da7b2ae-e971-48b6-91e7-7c8db8ee781f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:33 devstack sudo[94300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 1073741824 Sep 03 11:56:33 devstack sudo[94300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:33 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Volume volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 (45bf18c5-5fef-4cc5-88f2-4cd08f6fd351): created successfully Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9da7b2ae-e971-48b6-91e7-7c8db8ee781f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Flow 'volume_create_manager' (e8c993fb-62d1-427a-9c68-525ffb440928) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-76c5132a-b6f1-4918-8032-447114d8377f tempest-VolumesListAdminTestJSON-1897411468 None] Created volume successfully. Sep 03 11:56:34 devstack sudo[94300]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 1073741824" returned: 0 in 0.859s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:34 devstack sudo[94307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 Sep 03 11:56:34 devstack sudo[94307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:34 devstack sudo[94307]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4" returned: 0 in 0.471s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] <== create_volume: return (1390ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.393s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (78d31577-2edc-4f46-b223-3bbc74d834bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9bf1bf-3316-48a5-9228-885a346c4e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Volume volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 (d7c7bc52-339c-41f3-a87d-f2e4bd4044c4): created successfully Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc9bf1bf-3316-48a5-9228-885a346c4e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Flow 'volume_create_manager' (14551442-0ec5-4ba9-8147-14874089fe71) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5697b8ef-931e-492e-80ec-b1265a42375f tempest-AttachVolumeShelveTestJSON-2010647015 None] Created volume successfully. Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Flow 'volume_create_manager' (cf8222d4-52e4-4e84-86f4-ef107e626c6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa915fe-2715-4024-8a09-6dde0f9f64a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2aa915fe-2715-4024-8a09-6dde0f9f64a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadd491e-7486-4935-af34-fcae75efbaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df16797a11f49079e3f4ca37718f4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:36Z,use_quota=True,user_id='baf6a64507f94de5868276ef00f0d71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11684681-f08c-4f27-9c4d-b29498ed73d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (11684681-f08c-4f27-9c4d-b29498ed73d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adba309-4dec-4a8a-bae4-1b17aa733a3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3adba309-4dec-4a8a-bae4-1b17aa733a3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aadd491e-7486-4935-af34-fcae75efbaec', 'volume_name': 'volume-aadd491e-7486-4935-af34-fcae75efbaec', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c00094d-da46-41c4-bc2d-fa65d66b7fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c00094d-da46-41c4-bc2d-fa65d66b7fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405c2272-6bb1-402f-98ef-a3317e41cacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:35 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Volume aadd491e-7486-4935-af34-fcae75efbaec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aadd491e-7486-4935-af34-fcae75efbaec', 'volume_size': 1} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:35Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aadd491e-7486-4935-af34-fcae75efbaec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1df16797a11f49079e3f4ca37718f4de',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:36Z,use_quota=True,user_id='baf6a64507f94de5868276ef00f0d71e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Creating volume aadd491e-7486-4935-af34-fcae75efbaec {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:35 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:35 devstack sudo[94338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec 1073741824 Sep 03 11:56:35 devstack sudo[94338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:36 devstack sudo[94338]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec 1073741824" returned: 0 in 0.479s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:36 devstack sudo[94344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec Sep 03 11:56:36 devstack sudo[94344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:36 devstack sudo[94344]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec" returned: 0 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (405c2272-6bb1-402f-98ef-a3317e41cacd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aadd491e-7486-4935-af34-fcae75efbaec', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ad0e0f-68f9-45b7-a7c1-ba1518e39f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:36 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Volume volume-aadd491e-7486-4935-af34-fcae75efbaec (aadd491e-7486-4935-af34-fcae75efbaec): created successfully Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e3ad0e0f-68f9-45b7-a7c1-ba1518e39f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Flow 'volume_create_manager' (cf8222d4-52e4-4e84-86f4-ef107e626c6b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-37df2199-6540-4a14-a458-893224b7a762 tempest-VolumesListAdminTestJSON-258692370 None] Created volume successfully. Sep 03 11:56:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Acquiring lock "cinder-aadd491e-7486-4935-af34-fcae75efbaec-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Lock "cinder-aadd491e-7486-4935-af34-fcae75efbaec-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Acquiring lock "cinder-quobyte-aadd491e-7486-4935-af34-fcae75efbaec" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Lock "cinder-quobyte-aadd491e-7486-4935-af34-fcae75efbaec" acquired by "delete_volume" :: waited 0.046s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "cinder-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce51d1e-9d8b-4063-a8d7-7fc5bc037cd3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "cinder-quobyte-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-quobyte-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3722181b-bfe7-4405-af8d-ce237469b7c8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:38 devstack sudo[94361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec Sep 03 11:56:38 devstack sudo[94361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:38 devstack sudo[94362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 Sep 03 11:56:38 devstack sudo[94362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:38 devstack sudo[94361]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec" returned: 0 in 0.597s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:38 devstack sudo[94371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec Sep 03 11:56:38 devstack sudo[94362]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:38 devstack sudo[94371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351" returned: 0 in 0.421s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:38 devstack sudo[94373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351 Sep 03 11:56:38 devstack sudo[94373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:39 devstack sudo[94371]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aadd491e-7486-4935-af34-fcae75efbaec" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Lock "cinder-quobyte-aadd491e-7486-4935-af34-fcae75efbaec" released by "delete_volume" :: held 0.955s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:39 devstack sudo[94373]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351" returned: 0 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Created reservations ['a63151bb-71fc-4b79-a2ee-6cbbd0cfa636', 'e7805d15-b331-4f3e-8883-1566e1cbde94', '1c508f05-114a-4d00-bb1d-7e02eb27d4dd', '048e8893-7d95-40a3-8d09-a09cfb737f8a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-quobyte-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351" released by "delete_volume" :: held 0.797s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:39 devstack sudo[94378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:56:39 devstack sudo[94378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Created reservations ['fe9708a6-4902-439c-b462-a3f5ed080ec9', '8234948e-9020-485b-a394-945edf4a036a', '22758800-7ae5-4957-b12c-582d016e8b3c', '52f562c3-7a5c-45ee-b13d-d18b801e7499'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:39 devstack sudo[94385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:56:39 devstack sudo[94385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:39 devstack sudo[94378]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.444s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:56:39 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Deleted volume successfully. Sep 03 11:56:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-885b633b-274d-4143-98f8-719c7e96a69a tempest-VolumesListAdminTestJSON-258692370 None] Lock "cinder-aadd491e-7486-4935-af34-fcae75efbaec-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:39 devstack sudo[94385]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.488s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:56:40 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Deleted volume successfully. Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-680d8ea1-aabf-4cf6-933b-1d324985904b tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-45bf18c5-5fef-4cc5-88f2-4cd08f6fd351-delete_volume" released by "delete_volume" :: held 1.825s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "cinder-e30174a1-fb32-4c59-865a-152b0b2a95fc-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-e30174a1-fb32-4c59-865a-152b0b2a95fc-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "cinder-quobyte-e30174a1-fb32-4c59-865a-152b0b2a95fc" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-quobyte-e30174a1-fb32-4c59-865a-152b0b2a95fc" acquired by "delete_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e90ecbdf-9634-495a-b933-bb78c2398835]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:56:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:41 devstack sudo[94389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc Sep 03 11:56:41 devstack sudo[94389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:41 devstack sudo[94389]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc" returned: 0 in 0.740s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:41 devstack sudo[94394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc Sep 03 11:56:41 devstack sudo[94394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:41 devstack sudo[94394]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e30174a1-fb32-4c59-865a-152b0b2a95fc" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-quobyte-e30174a1-fb32-4c59-865a-152b0b2a95fc" released by "delete_volume" :: held 1.139s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:41 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Created reservations ['87eadd04-8c33-4766-838b-2e2ebc611ab1', '1743c1f3-477e-42e3-b33c-a4b0bb7ce27f', 'a14a694b-b12a-445a-8e91-3e2037aa5cf2', '96c64e3a-6546-4d6a-af16-b39f86ab0122'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:42 devstack sudo[94398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:56:42 devstack sudo[94398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:42 devstack sudo[94398]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.335s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:56:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Deleted volume successfully. Sep 03 11:56:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53dde59d-6874-4ea1-8882-a06fc778707a tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-e30174a1-fb32-4c59-865a-152b0b2a95fc-delete_volume" released by "delete_volume" :: held 1.789s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "cinder-72b83178-ee2b-4e50-88e8-0e204387cffc-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-72b83178-ee2b-4e50-88e8-0e204387cffc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "cinder-quobyte-72b83178-ee2b-4e50-88e8-0e204387cffc" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-quobyte-72b83178-ee2b-4e50-88e8-0e204387cffc" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0037972-679f-4558-9330-e3f9bc3a3018]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:43 devstack sudo[94402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc Sep 03 11:56:43 devstack sudo[94402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:43 devstack sudo[94402]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc" returned: 0 in 0.439s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:43 devstack sudo[94409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc Sep 03 11:56:43 devstack sudo[94409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:44 devstack sudo[94409]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-72b83178-ee2b-4e50-88e8-0e204387cffc" returned: 0 in 0.514s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-quobyte-72b83178-ee2b-4e50-88e8-0e204387cffc" released by "delete_volume" :: held 1.027s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Created reservations ['2e39eae8-6abd-4a78-b53d-c291ae8c9b5c', 'bf4b943c-4134-42af-870b-a5a1671a751e', '0921a593-bdff-4779-9e23-cbacc0e5c11a', '3f285eab-ec2f-4dc3-9fa4-e071b23c121f'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:44 devstack sudo[94432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:56:44 devstack sudo[94432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:44 devstack sudo[94432]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.318s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:56:44 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Deleted volume successfully. Sep 03 11:56:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-edb5b5c3-9356-4596-a403-d4b32f76206e tempest-VolumesListAdminTestJSON-1897411468 None] Lock "cinder-72b83178-ee2b-4e50-88e8-0e204387cffc-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Flow 'volume_create_manager' (92cfc0fd-9fdf-4a4b-b9c4-64d134db8664) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87949b7-9eae-4536-a066-eae74161308e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f87949b7-9eae-4536-a066-eae74161308e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2032995089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3468303f-0445-4f5b-92d5-0b1846fde877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ae91247cc54b75918cb927a1dc5a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:45Z,use_quota=True,user_id='06f33a2ef02a4aa3ad9f3e0d8d9a068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf1424c-e09b-4d21-91d7-7603dae283b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fdf1424c-e09b-4d21-91d7-7603dae283b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f427d51-57b5-4e66-a9f0-b3a0f99aacfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f427d51-57b5-4e66-a9f0-b3a0f99aacfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3468303f-0445-4f5b-92d5-0b1846fde877', 'volume_name': 'volume-3468303f-0445-4f5b-92d5-0b1846fde877', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6029c0de-9bce-4f9d-b2b8-5b09c0438583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6029c0de-9bce-4f9d-b2b8-5b09c0438583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ce9f04-f0b2-478a-9a07-fb260e30e4e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:45 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Volume 3468303f-0445-4f5b-92d5-0b1846fde877: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3468303f-0445-4f5b-92d5-0b1846fde877', 'volume_size': 1} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-2032995089',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3468303f-0445-4f5b-92d5-0b1846fde877,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='35ae91247cc54b75918cb927a1dc5a18',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:45Z,use_quota=True,user_id='06f33a2ef02a4aa3ad9f3e0d8d9a068c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Creating volume 3468303f-0445-4f5b-92d5-0b1846fde877 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:45 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:45 devstack sudo[94461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 1073741824 Sep 03 11:56:45 devstack sudo[94461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:45 devstack sudo[94461]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 1073741824" returned: 0 in 0.465s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:45 devstack sudo[94467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 Sep 03 11:56:45 devstack sudo[94467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:46 devstack sudo[94467]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877" returned: 0 in 0.279s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ce9f04-f0b2-478a-9a07-fb260e30e4e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3468303f-0445-4f5b-92d5-0b1846fde877', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a1399a-0aab-4239-b9d3-36334c7872f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Volume volume-3468303f-0445-4f5b-92d5-0b1846fde877 (3468303f-0445-4f5b-92d5-0b1846fde877): created successfully Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92a1399a-0aab-4239-b9d3-36334c7872f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Flow 'volume_create_manager' (92cfc0fd-9fdf-4a4b-b9c4-64d134db8664) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-afc187a1-63ed-45a9-a7bc-bd90d66341c8 tempest-AttachVolumeNegativeTest-1161512630 None] Created volume successfully. Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-140addc5-2cd9-4cf9-a716-25f8f2dc5707 req-0d82a6e2-b005-4025-bb99-8d9da79033b9 tempest-AttachVolumeShelveTestJSON-2010647015 None] No connector for attachment 28688caf-9703-4398-b7a1-603411ddec50; skipping storage backend terminate_connection call. {{(pid=87256) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Sep 03 11:56:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-140addc5-2cd9-4cf9-a716-25f8f2dc5707 req-0d82a6e2-b005-4025-bb99-8d9da79033b9 tempest-AttachVolumeShelveTestJSON-2010647015 None] Deleting attachment 28688caf-9703-4398-b7a1-603411ddec50. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:56:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-cdb8f575-e691-4ba3-95bf-b8039beeb9ae req-d97894a6-b4a7-4b1d-80c2-ede01c987ac3 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-cdb8f575-e691-4ba3-95bf-b8039beeb9ae req-d97894a6-b4a7-4b1d-80c2-ede01c987ac3 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-cdb8f575-e691-4ba3-95bf-b8039beeb9ae req-d97894a6-b4a7-4b1d-80c2-ede01c987ac3 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-cdb8f575-e691-4ba3-95bf-b8039beeb9ae req-d97894a6-b4a7-4b1d-80c2-ede01c987ac3 tempest-AttachVolumeNegativeTest-1161512630 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-3468303f-0445-4f5b-92d5-0b1846fde877', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e4384c6e-6b5d-443e-a1f8-e0ed3c4cdeac', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:56:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-cdb8f575-e691-4ba3-95bf-b8039beeb9ae req-d97894a6-b4a7-4b1d-80c2-ede01c987ac3 tempest-AttachVolumeNegativeTest-1161512630 None] attachment_update completed successfully. Sep 03 11:56:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-1345f755-9f17-4785-873a-809136c63f9d req-481b0f21-9f7a-4ed3-81cc-c5f3c2ca1a50 tempest-AttachVolumeNegativeTest-1161512630 None] Terminate volume connection completed successfully. Sep 03 11:56:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-1345f755-9f17-4785-873a-809136c63f9d req-481b0f21-9f7a-4ed3-81cc-c5f3c2ca1a50 tempest-AttachVolumeNegativeTest-1161512630 None] Deleting attachment e4384c6e-6b5d-443e-a1f8-e0ed3c4cdeac. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Flow 'volume_create_manager' (ab4b0c23-8755-4cab-991b-0f69cec2b14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d1e4b6-aa9f-4f67-bf0d-64307e12bb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (75d1e4b6-aa9f-4f67-bf0d-64307e12bb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1566098633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408e99a6115842dba296078f62ff3b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:56Z,use_quota=True,user_id='14bdbce12e914fd896d31db8d5613897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a425f98e-ba03-458d-908d-913359fcc5ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a425f98e-ba03-458d-908d-913359fcc5ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7176608e-d261-4604-9de9-f22b59be8b92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7176608e-d261-4604-9de9-f22b59be8b92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112', 'volume_name': 'volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7568b9-40ea-4f89-9ebe-4ff600781cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0c7568b9-40ea-4f89-9ebe-4ff600781cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2196e7-df60-48b7-aad7-d5936c1732e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Volume b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112', 'volume_size': 1} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1566098633',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408e99a6115842dba296078f62ff3b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:56Z,use_quota=True,user_id='14bdbce12e914fd896d31db8d5613897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Creating volume b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:56 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:56 devstack sudo[94959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 1073741824 Sep 03 11:56:56 devstack sudo[94959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Flow 'volume_create_manager' (bad9e447-e56b-4ee0-a7a4-c395e0d7dbac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdf1145-79b1-4954-8ae1-93591b78e4ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7fdf1145-79b1-4954-8ae1-93591b78e4ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-920410822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94192199-8bf9-4dc9-bff9-7a4d883eff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc424b332cca44f193d2fe904413c7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:56Z,use_quota=True,user_id='280ba1de5b8743229b2ac708f3882327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb70f842-4f9f-457f-9272-0630f6fb1af5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb70f842-4f9f-457f-9272-0630f6fb1af5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea5b9e-3b50-4ea9-b918-a110e351f59c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ea5b9e-3b50-4ea9-b918-a110e351f59c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94192199-8bf9-4dc9-bff9-7a4d883eff25', 'volume_name': 'volume-94192199-8bf9-4dc9-bff9-7a4d883eff25', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1686893-9812-4205-b68a-588d90aca6b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e1686893-9812-4205-b68a-588d90aca6b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb53028-677f-426b-b980-b5e364933282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:56 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Volume 94192199-8bf9-4dc9-bff9-7a4d883eff25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94192199-8bf9-4dc9-bff9-7a4d883eff25', 'volume_size': 1} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:56 devstack sudo[94959]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 1073741824" returned: 0 in 0.576s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:56 devstack sudo[94965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 Sep 03 11:56:56 devstack sudo[94965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:57 devstack sudo[94965]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.654s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:56:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-920410822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94192199-8bf9-4dc9-bff9-7a4d883eff25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc424b332cca44f193d2fe904413c7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:56:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:56:56Z,use_quota=True,user_id='280ba1de5b8743229b2ac708f3882327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Creating volume 94192199-8bf9-4dc9-bff9-7a4d883eff25 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:56:57 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd2196e7-df60-48b7-aad7-d5936c1732e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eba3e5e-c1dc-466c-ba68-089280d00cee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:57 devstack sudo[94968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 1073741824 Sep 03 11:56:57 devstack sudo[94968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Volume volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 (b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112): created successfully Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6eba3e5e-c1dc-466c-ba68-089280d00cee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Flow 'volume_create_manager' (ab4b0c23-8755-4cab-991b-0f69cec2b14e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e642d34b-0152-416b-81d2-16de2a43e9b4 tempest-VolumesTransfersTest-1459100348 None] Created volume successfully. Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "cinder-3468303f-0445-4f5b-92d5-0b1846fde877-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-3468303f-0445-4f5b-92d5-0b1846fde877-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "cinder-quobyte-3468303f-0445-4f5b-92d5-0b1846fde877" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-quobyte-3468303f-0445-4f5b-92d5-0b1846fde877" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5886705b-d9db-4576-b82c-89584db50177]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:57 devstack sudo[94968]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 1073741824" returned: 0 in 0.942s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:58 devstack sudo[95025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 Sep 03 11:56:58 devstack sudo[95025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:58 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 Sep 03 11:56:58 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:58 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25" returned: 0 in 0.537s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] <== create_volume: return (1565ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.574s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6fb53028-677f-426b-b980-b5e364933282) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94192199-8bf9-4dc9-bff9-7a4d883eff25', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef649003-10de-48a7-80a6-598a48cd591a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:56:58 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Volume volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 (94192199-8bf9-4dc9-bff9-7a4d883eff25): created successfully Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef649003-10de-48a7-80a6-598a48cd591a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Flow 'volume_create_manager' (bad9e447-e56b-4ee0-a7a4-c395e0d7dbac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:56:58 devstack sudo[95025]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877" returned: 0 in 0.858s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8631c4e6-9629-462a-8539-8d054ac6835a tempest-AttachVolumeTestJSON-1352568732 None] Created volume successfully. Sep 03 11:56:58 devstack sudo[95049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877 Sep 03 11:56:58 devstack sudo[95049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:58 devstack sudo[95049]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3468303f-0445-4f5b-92d5-0b1846fde877" returned: 0 in 0.292s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-quobyte-3468303f-0445-4f5b-92d5-0b1846fde877" released by "delete_volume" :: held 1.231s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Created reservations ['ed8531a9-4e1a-4a05-bc2e-d70c8020f19d', '2d848e6d-527b-4473-b6e7-4bee6526ee7d', 'abe8d618-1ae2-4d1b-9b34-dfcebfd3bc65', '386a47c9-2ceb-43fe-a35f-186f3087f973'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:56:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3966491d-c284-48bc-9aa8-19fe62928b6e tempest-VolumesTransfersTest-1760462416 None] Transfer volume completed successfully. Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:56:59 devstack sudo[95054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:56:59 devstack sudo[95054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:56:59 devstack sudo[95054]: pam_unix(sudo:session): session closed for user root Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.736s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:56:59 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:56:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Deleted volume successfully. Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-90de9ff1-ec93-456d-af82-07ea99fb61d9 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-3468303f-0445-4f5b-92d5-0b1846fde877-delete_volume" released by "delete_volume" :: held 2.407s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Acquiring lock "cinder-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Lock "cinder-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "cinder-4dc5071a-9bf8-4921-9fcd-d2f35a509971-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Acquiring lock "cinder-quobyte-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-4dc5071a-9bf8-4921-9fcd-d2f35a509971-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Lock "cinder-quobyte-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112" acquired by "delete_volume" :: waited 0.058s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "cinder-quobyte-4dc5071a-9bf8-4921-9fcd-d2f35a509971" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f774686b-cc1d-4a6f-8e59-7f2244cc3bf2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-quobyte-4dc5071a-9bf8-4921-9fcd-d2f35a509971" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb2edf12-5734-488b-b8f4-1cc4e7d11361]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:00 devstack sudo[95061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 Sep 03 11:57:00 devstack sudo[95061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:00 devstack sudo[95066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 Sep 03 11:57:00 devstack sudo[95066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-b68441a4-7f73-49e1-8ad9-a5c2c6f71fa6 req-50b7d637-fbc0-4f6d-9ccd-381607afbe0d tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-b68441a4-7f73-49e1-8ad9-a5c2c6f71fa6 req-50b7d637-fbc0-4f6d-9ccd-381607afbe0d tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-b68441a4-7f73-49e1-8ad9-a5c2c6f71fa6 req-50b7d637-fbc0-4f6d-9ccd-381607afbe0d tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-b68441a4-7f73-49e1-8ad9-a5c2c6f71fa6 req-50b7d637-fbc0-4f6d-9ccd-381607afbe0d tempest-AttachVolumeTestJSON-1352568732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-94192199-8bf9-4dc9-bff9-7a4d883eff25', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '305a359c-22fb-45eb-bbea-1f7fff93c2e9', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:57:00 devstack sudo[95061]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112" returned: 0 in 0.503s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-b68441a4-7f73-49e1-8ad9-a5c2c6f71fa6 req-50b7d637-fbc0-4f6d-9ccd-381607afbe0d tempest-AttachVolumeTestJSON-1352568732 None] attachment_update completed successfully. Sep 03 11:57:01 devstack sudo[95080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112 Sep 03 11:57:01 devstack sudo[95080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:01 devstack sudo[95066]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971" returned: 0 in 0.508s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:01 devstack sudo[95082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971 Sep 03 11:57:01 devstack sudo[95082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:01 devstack sudo[95080]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112" returned: 0 in 0.409s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Lock "cinder-quobyte-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112" released by "delete_volume" :: held 0.973s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:01 devstack sudo[95082]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4dc5071a-9bf8-4921-9fcd-d2f35a509971" returned: 0 in 0.376s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-quobyte-4dc5071a-9bf8-4921-9fcd-d2f35a509971" released by "delete_volume" :: held 0.969s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Created reservations ['e88fc6b4-c833-48d1-99e7-669051cae15d', 'a3702582-a2a2-423d-bb95-fb276d887e46', 'c8a60099-ace7-4787-bd68-2f292e2b0be1', 'b6f5172f-b3e9-4873-825b-726b37d8c6f1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Created reservations ['1f6b56d2-d1ed-4441-96af-018708fc4f0f', 'a8516004-ffa6-4504-8970-7f4197c0a3fd', '458d69a5-3dd3-4cfe-8b1d-015c2097aabc', '3e63bd7b-6b53-4ebb-ac42-6257e2fc41dd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:01 devstack sudo[95469]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:01 devstack sudo[95469]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:01 devstack sudo[95471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:01 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:02 devstack sudo[95469]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:02 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Deleted volume successfully. Sep 03 11:57:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1c4f887-fba1-4872-821e-39818671e6d7 tempest-VolumesTransfersTest-147406253 None] Lock "cinder-b5fc8eaa-8d9e-4b63-adff-8b7f3c72a112-delete_volume" released by "delete_volume" :: held 1.847s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:02 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.428s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:02 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Deleted volume successfully. Sep 03 11:57:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6faeb01-6c0c-463c-9aae-56a514779fe4 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-4dc5071a-9bf8-4921-9fcd-d2f35a509971-delete_volume" released by "delete_volume" :: held 1.811s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "cinder-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "cinder-quobyte-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-quobyte-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[46b5ad8f-a88c-4c7c-8923-ab0349d6f2a4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Flow 'volume_create_manager' (4f59c497-cc31-442e-b38b-5c0c8848115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83da3873-e28e-4815-817c-ddc68e79e132) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack sudo[95477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 Sep 03 11:57:03 devstack sudo[95477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (83da3873-e28e-4815-817c-ddc68e79e132) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1352355753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9575d5-8710-40d5-a4f3-daa767d3cc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408e99a6115842dba296078f62ff3b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:03Z,use_quota=True,user_id='14bdbce12e914fd896d31db8d5613897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041dceca-4865-48b5-894f-d821d3588017) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (041dceca-4865-48b5-894f-d821d3588017) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f688dbc-763e-47ae-a412-312fd31be889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f688dbc-763e-47ae-a412-312fd31be889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4d9575d5-8710-40d5-a4f3-daa767d3cc67', 'volume_name': 'volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78c9760-46bb-4382-b994-4d0f93fdf636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c78c9760-46bb-4382-b994-4d0f93fdf636) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a778d1-8e70-4fb2-90c1-b6856017cb43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Volume 4d9575d5-8710-40d5-a4f3-daa767d3cc67: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67', 'volume_size': 1} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1352355753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4d9575d5-8710-40d5-a4f3-daa767d3cc67,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='408e99a6115842dba296078f62ff3b2c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:03Z,use_quota=True,user_id='14bdbce12e914fd896d31db8d5613897',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Creating volume 4d9575d5-8710-40d5-a4f3-daa767d3cc67 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:03 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:03 devstack sudo[95479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 1073741824 Sep 03 11:57:03 devstack sudo[95479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:03 devstack sudo[95477]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5" returned: 0 in 0.496s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:03 devstack sudo[95488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5 Sep 03 11:57:03 devstack sudo[95488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Flow 'volume_create_manager' (50482434-e769-42ed-8b54-afe9bfe14e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb545059-866e-4335-b51b-eee421c232e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb545059-866e-4335-b51b-eee421c232e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2119142873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0724045c-f714-400e-98a6-2224d3c51451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc424b332cca44f193d2fe904413c7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:04Z,use_quota=True,user_id='280ba1de5b8743229b2ac708f3882327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6995ca4d-1f91-4256-a786-d509872cec5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6995ca4d-1f91-4256-a786-d509872cec5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf4bc0d-f16a-4edb-9425-e3415575af86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4cf4bc0d-f16a-4edb-9425-e3415575af86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0724045c-f714-400e-98a6-2224d3c51451', 'volume_name': 'volume-0724045c-f714-400e-98a6-2224d3c51451', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be7ebcc-9239-431a-8f69-1e21b2fd7243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4be7ebcc-9239-431a-8f69-1e21b2fd7243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d05a46d-ec28-4b9c-99b5-7ad348d5caec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:03 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Volume 0724045c-f714-400e-98a6-2224d3c51451: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0724045c-f714-400e-98a6-2224d3c51451', 'volume_size': 1} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:03 devstack sudo[95479]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 1073741824" returned: 0 in 0.494s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:03 devstack sudo[95490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 Sep 03 11:57:03 devstack sudo[95490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:03 devstack sudo[95488]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5" returned: 0 in 0.299s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-quobyte-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5" released by "delete_volume" :: held 0.866s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Created reservations ['1d16b31e-99ad-408f-a051-ff6a85750bb1', '532da439-65f6-48fd-9d85-d7637ed5cdfb', 'b5702ae0-a081-4e78-802c-9970c359d952', '608c9cea-4f05-468c-81d9-2af22d435c0a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:04 devstack sudo[95493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:04 devstack sudo[95493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:04 devstack sudo[95490]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] <== create_volume: return (844ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.849s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.388s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2119142873',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0724045c-f714-400e-98a6-2224d3c51451,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fc424b332cca44f193d2fe904413c7b5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:04Z,use_quota=True,user_id='280ba1de5b8743229b2ac708f3882327',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Creating volume 0724045c-f714-400e-98a6-2224d3c51451 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:04 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2a778d1-8e70-4fb2-90c1-b6856017cb43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e24838e-58a6-4fea-ac06-3e69e1b5279c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:04 devstack sudo[95496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 1073741824 Sep 03 11:57:04 devstack sudo[95496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:04 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Volume volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 (4d9575d5-8710-40d5-a4f3-daa767d3cc67): created successfully Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e24838e-58a6-4fea-ac06-3e69e1b5279c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Flow 'volume_create_manager' (4f59c497-cc31-442e-b38b-5c0c8848115b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-29a42a0d-2e6f-4af0-b271-96e7820192f1 tempest-VolumesTransfersTest-1459100348 None] Created volume successfully. Sep 03 11:57:04 devstack sudo[95493]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.339s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Deleted volume successfully. Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-644fcd9f-7c59-4ab9-b136-79f2b6bd0b43 tempest-AttachVolumeNegativeTest-1161512630 None] Lock "cinder-dcb7c7b5-cc02-487e-9a1d-580f0681f2a5-delete_volume" released by "delete_volume" :: held 1.452s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:04 devstack sudo[95496]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 1073741824" returned: 0 in 0.573s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:04 devstack sudo[95503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 Sep 03 11:57:04 devstack sudo[95503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:05 devstack sudo[95503]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451" returned: 0 in 0.259s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.884s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d05a46d-ec28-4b9c-99b5-7ad348d5caec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0724045c-f714-400e-98a6-2224d3c51451', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401ac40c-4de3-4054-86f6-779dc6a59542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:05 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Volume volume-0724045c-f714-400e-98a6-2224d3c51451 (0724045c-f714-400e-98a6-2224d3c51451): created successfully Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (401ac40c-4de3-4054-86f6-779dc6a59542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Flow 'volume_create_manager' (50482434-e769-42ed-8b54-afe9bfe14e29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d88959c0-c775-4644-95ab-e490beee817d tempest-AttachVolumeTestJSON-1352568732 None] Created volume successfully. Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Acquiring lock "cinder-4d9575d5-8710-40d5-a4f3-daa767d3cc67-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Lock "cinder-4d9575d5-8710-40d5-a4f3-daa767d3cc67-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Acquiring lock "cinder-quobyte-4d9575d5-8710-40d5-a4f3-daa767d3cc67" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Lock "cinder-quobyte-4d9575d5-8710-40d5-a4f3-daa767d3cc67" acquired by "delete_volume" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9eeb06a9-0f26-4d89-a9de-b4b57846f88a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:06 devstack sudo[95506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 Sep 03 11:57:06 devstack sudo[95506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:06 devstack sudo[95506]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67" returned: 0 in 0.456s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:06 devstack sudo[95516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67 Sep 03 11:57:06 devstack sudo[95516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:06 devstack sudo[95516]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4d9575d5-8710-40d5-a4f3-daa767d3cc67" returned: 0 in 0.371s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Lock "cinder-quobyte-4d9575d5-8710-40d5-a4f3-daa767d3cc67" released by "delete_volume" :: held 0.900s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Created reservations ['0350ce72-2bd1-40bd-9aff-ec7d0e5edf74', '9054f159-4906-4360-aadd-f88efb861c39', 'a0713581-4e24-4fc2-9a72-8a15ccb1059d', 'd45ff751-fc4a-4e03-b816-b033f36664ec'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-0079bc0a-3464-41e8-9e4f-77deee81726a req-b3efd070-f59a-426c-a4c4-9173a1605ef6 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-0079bc0a-3464-41e8-9e4f-77deee81726a req-b3efd070-f59a-426c-a4c4-9173a1605ef6 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-0079bc0a-3464-41e8-9e4f-77deee81726a req-b3efd070-f59a-426c-a4c4-9173a1605ef6 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.027s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-0079bc0a-3464-41e8-9e4f-77deee81726a req-b3efd070-f59a-426c-a4c4-9173a1605ef6 tempest-AttachVolumeTestJSON-1352568732 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-0724045c-f714-400e-98a6-2224d3c51451', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c6e4fe89-20de-4959-90c4-81e2586de7d9', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:07 devstack sudo[95527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:07 devstack sudo[95527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-0079bc0a-3464-41e8-9e4f-77deee81726a req-b3efd070-f59a-426c-a4c4-9173a1605ef6 tempest-AttachVolumeTestJSON-1352568732 None] attachment_update completed successfully. Sep 03 11:57:07 devstack sudo[95527]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.304s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Deleted volume successfully. Sep 03 11:57:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c3535a73-1f07-42d0-a1d1-657416b4303d tempest-VolumesTransfersTest-147406253 None] Lock "cinder-4d9575d5-8710-40d5-a4f3-daa767d3cc67-delete_volume" released by "delete_volume" :: held 1.636s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:10 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-20ebc6d9-f877-47ff-8110-4402b3fa9dff req-64cd6cb4-b0cf-4e9a-97d5-693c81adb9d1 tempest-AttachVolumeTestJSON-1352568732 None] Terminate volume connection completed successfully. Sep 03 11:57:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-20ebc6d9-f877-47ff-8110-4402b3fa9dff req-64cd6cb4-b0cf-4e9a-97d5-693c81adb9d1 tempest-AttachVolumeTestJSON-1352568732 None] Deleting attachment 305a359c-22fb-45eb-bbea-1f7fff93c2e9. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:57:11 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=98,cinder:UPDATE=118,cinder:INSERT=26,cinder:DELETE=9 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:57:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-015f8a18-247b-4e9d-960a-d710fe300102 req-02e66819-57d8-442a-91fe-899fc8e6021f tempest-AttachVolumeTestJSON-1352568732 None] Terminate volume connection completed successfully. Sep 03 11:57:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-015f8a18-247b-4e9d-960a-d710fe300102 req-02e66819-57d8-442a-91fe-899fc8e6021f tempest-AttachVolumeTestJSON-1352568732 None] Deleting attachment c6e4fe89-20de-4959-90c4-81e2586de7d9. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Flow 'volume_create_manager' (4ec49906-0859-400f-a6f8-abba2fce1c38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2006ba7-f187-4c20-b374-4473f9a49ad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2006ba7-f187-4c20-b374-4473f9a49ad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-394513730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de150040-c229-4fde-894f-9fcf413bafd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f58bf246e9564c5185d32bab632f84ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:15Z,use_quota=True,user_id='a279ee54deda42ccb651c9c51105beab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ceed425-d8b5-4515-b65e-76c8b4ad4f0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4ceed425-d8b5-4515-b65e-76c8b4ad4f0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdf2df0-e9fd-4b65-ada4-fe3c46636235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cdf2df0-e9fd-4b65-ada4-fe3c46636235) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de150040-c229-4fde-894f-9fcf413bafd3', 'volume_name': 'volume-de150040-c229-4fde-894f-9fcf413bafd3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e8d8f0-fcea-492e-8c2f-5f2d71657f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97e8d8f0-fcea-492e-8c2f-5f2d71657f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b1eac7-818b-4e0f-bdaa-7def0a1792fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Volume de150040-c229-4fde-894f-9fcf413bafd3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de150040-c229-4fde-894f-9fcf413bafd3', 'volume_size': 1} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-394513730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de150040-c229-4fde-894f-9fcf413bafd3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f58bf246e9564c5185d32bab632f84ab',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:15Z,use_quota=True,user_id='a279ee54deda42ccb651c9c51105beab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Creating volume de150040-c229-4fde-894f-9fcf413bafd3 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:15 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:15 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 1073741824 Sep 03 11:57:15 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:15 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 1073741824" returned: 0 in 0.462s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:16 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 Sep 03 11:57:16 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:16 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.787s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1b1eac7-818b-4e0f-bdaa-7def0a1792fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de150040-c229-4fde-894f-9fcf413bafd3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:16 devstack sudo[95606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:16 devstack sudo[95606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22a37c0-9995-4419-8ad1-fe19208f63a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:16 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Volume volume-de150040-c229-4fde-894f-9fcf413bafd3 (de150040-c229-4fde-894f-9fcf413bafd3): created successfully Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e22a37c0-9995-4419-8ad1-fe19208f63a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Flow 'volume_create_manager' (4ec49906-0859-400f-a6f8-abba2fce1c38) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-deaf4b33-152c-4a5e-a242-7055e98524df req-06a8ba19-3d88-4bf4-9b84-77f836434717 tempest-VolumesGetTestJSON-2085337026 None] Created volume successfully. Sep 03 11:57:16 devstack sudo[95606]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.333s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:57:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Acquiring lock "cinder-de150040-c229-4fde-894f-9fcf413bafd3-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Lock "cinder-de150040-c229-4fde-894f-9fcf413bafd3-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Acquiring lock "cinder-quobyte-de150040-c229-4fde-894f-9fcf413bafd3" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Lock "cinder-quobyte-de150040-c229-4fde-894f-9fcf413bafd3" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "cinder-0724045c-f714-400e-98a6-2224d3c51451-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0bbd2c31-7399-4cac-a2a1-3c91d0a4ca38]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-0724045c-f714-400e-98a6-2224d3c51451-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "cinder-quobyte-0724045c-f714-400e-98a6-2224d3c51451" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-quobyte-0724045c-f714-400e-98a6-2224d3c51451" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b7edb44-206f-499a-a2fb-315e7383a4b3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:17 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 Sep 03 11:57:17 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:17 devstack sudo[95610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 Sep 03 11:57:17 devstack sudo[95610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:17 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3" returned: 0 in 0.430s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:17 devstack sudo[95617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3 Sep 03 11:57:17 devstack sudo[95617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:17 devstack sudo[95610]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451" returned: 0 in 0.393s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:17 devstack sudo[95622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451 Sep 03 11:57:17 devstack sudo[95622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:17 devstack sudo[95617]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de150040-c229-4fde-894f-9fcf413bafd3" returned: 0 in 0.275s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Lock "cinder-quobyte-de150040-c229-4fde-894f-9fcf413bafd3" released by "delete_volume" :: held 0.771s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Flow 'volume_create_manager' (fe318c77-043a-4356-a84e-ae79b4b9a3d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd52c519-25f4-4b31-a8d5-e5a026632a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:17 devstack sudo[95622]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fd52c519-25f4-4b31-a8d5-e5a026632a1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1559222112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb28b41-4dc7-4503-976f-c9b02eab66ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99b6bf79aa64252976334a70b11f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:18Z,use_quota=True,user_id='3c0dfb387e2b43d19edfb85510ed3eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e9a641-25db-4f74-8f03-27805e1bf8f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57e9a641-25db-4f74-8f03-27805e1bf8f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d59914-56cb-4bfa-91b4-fda33b607bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d6d59914-56cb-4bfa-91b4-fda33b607bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb28b41-4dc7-4503-976f-c9b02eab66ae', 'volume_name': 'volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac02c52-d079-4426-94fc-a8fd83ff06f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cac02c52-d079-4426-94fc-a8fd83ff06f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f2b608-ec1f-4f03-8b7a-700cffdf852e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Volume bcb28b41-4dc7-4503-976f-c9b02eab66ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae', 'volume_size': 1} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1559222112',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb28b41-4dc7-4503-976f-c9b02eab66ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99b6bf79aa64252976334a70b11f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:18Z,use_quota=True,user_id='3c0dfb387e2b43d19edfb85510ed3eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Creating volume bcb28b41-4dc7-4503-976f-c9b02eab66ae {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:18 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0724045c-f714-400e-98a6-2224d3c51451" returned: 0 in 0.360s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:18 devstack sudo[95626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae 1073741824 Sep 03 11:57:18 devstack sudo[95626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-quobyte-0724045c-f714-400e-98a6-2224d3c51451" released by "delete_volume" :: held 0.795s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.quota [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Created reservations ['55b849ef-fce2-4b7b-a2ed-fd43c16de1ef', '715e543e-bfa0-415a-851b-c039c8d86270', 'ea1e688b-9ea8-449e-bc4a-0003be847add', '22ead0dd-a1a1-4e60-90b3-197dafc4b128'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Created reservations ['02417074-2154-46b8-bb36-4f5910deed71', 'aa103cc4-3277-4ffe-8774-252b9879a374', 'e5572d64-1ed7-4573-8003-b911309f6039', '9c859e5d-eb18-4b88-a027-3208eb45e341'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:18 devstack sudo[95628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:18 devstack sudo[95628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:18 devstack sudo[95630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:18 devstack sudo[95630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "cinder-94192199-8bf9-4dc9-bff9-7a4d883eff25-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-94192199-8bf9-4dc9-bff9-7a4d883eff25-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "cinder-quobyte-94192199-8bf9-4dc9-bff9-7a4d883eff25" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-quobyte-94192199-8bf9-4dc9-bff9-7a4d883eff25" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:18 devstack sudo[95628]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.464s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.manager [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Deleted volume successfully. Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5ffe8d2-3b74-4c8e-8980-2ca34c782a20]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:18 devstack sudo[95626]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae 1073741824" returned: 0 in 0.684s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-3b36d0cd-e3e9-4545-9c68-318b8ff3c06a req-0f21e274-165e-443b-8ee4-7cbe131c1ae9 tempest-VolumesGetTestJSON-2085337026 None] Lock "cinder-de150040-c229-4fde-894f-9fcf413bafd3-delete_volume" released by "delete_volume" :: held 1.670s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:18 devstack sudo[95630]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.517s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Deleted volume successfully. Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:18 devstack sudo[95670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 Sep 03 11:57:18 devstack sudo[95670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-87f138b1-103a-4c14-97bf-cb4cebf17918 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-0724045c-f714-400e-98a6-2224d3c51451-delete_volume" released by "delete_volume" :: held 1.668s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:18 devstack sudo[95672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae Sep 03 11:57:18 devstack sudo[95672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:19 devstack sudo[95670]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25" returned: 0 in 0.502s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:19 devstack sudo[95678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25 Sep 03 11:57:19 devstack sudo[95678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:19 devstack sudo[95672]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae" returned: 0 in 0.455s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] <== create_volume: return (1270ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.273s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5f2b608-ec1f-4f03-8b7a-700cffdf852e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f109cbb4-34b4-447a-af12-49fea2f57800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:19 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Volume volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae (bcb28b41-4dc7-4503-976f-c9b02eab66ae): created successfully Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f109cbb4-34b4-447a-af12-49fea2f57800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Flow 'volume_create_manager' (fe318c77-043a-4356-a84e-ae79b4b9a3d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b59876a6-c47f-4171-b71e-4de745bf4248 tempest-VolumesTransfersV357Test-1483008676 None] Created volume successfully. Sep 03 11:57:19 devstack sudo[95678]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94192199-8bf9-4dc9-bff9-7a4d883eff25" returned: 0 in 0.296s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-quobyte-94192199-8bf9-4dc9-bff9-7a4d883eff25" released by "delete_volume" :: held 0.880s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Created reservations ['9b2e3eeb-87d2-49c4-8968-2b7aff7c2668', 'e66fec6a-2df3-451a-9b79-c29c649fafbb', '40c9edf9-05a1-4c6b-96f3-197ed019529b', 'a3f4de3e-257b-4938-8748-0671ae10650b'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:19 devstack sudo[95684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:19 devstack sudo[95684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "cinder-724eb31f-8331-4468-8752-bf3c8de077e3-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-724eb31f-8331-4468-8752-bf3c8de077e3-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "cinder-quobyte-724eb31f-8331-4468-8752-bf3c8de077e3" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-quobyte-724eb31f-8331-4468-8752-bf3c8de077e3" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:19 devstack sudo[95684]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.292s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Deleted volume successfully. Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[de3987d6-900e-40b0-a353-3d8aad947ae0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-95bff594-4c0c-479b-ab6b-237b314d8feb tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-94192199-8bf9-4dc9-bff9-7a4d883eff25-delete_volume" released by "delete_volume" :: held 1.476s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:20 devstack sudo[95687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 Sep 03 11:57:20 devstack sudo[95687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:20 devstack sudo[95687]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3" returned: 0 in 0.426s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:20 devstack sudo[95693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3 Sep 03 11:57:20 devstack sudo[95693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:20 devstack sudo[95693]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-724eb31f-8331-4468-8752-bf3c8de077e3" returned: 0 in 0.300s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-quobyte-724eb31f-8331-4468-8752-bf3c8de077e3" released by "delete_volume" :: held 0.781s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Created reservations ['7f2f66ee-439e-49aa-9588-67df2f08cc91', '9f6364de-28d9-4ea2-903c-45e35a430bcb', '169ba72f-f220-434c-976c-50f714241d34', '554be9f9-37d5-484d-9ffc-ed7fed639403'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:20 devstack sudo[95698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:20 devstack sudo[95698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a50f6a37-9c81-497a-8f29-4731a432c4fa tempest-VolumesTransfersV357Test-1026047654 None] Transfer volume completed successfully. Sep 03 11:57:21 devstack sudo[95698]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.397s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:21 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Deleted volume successfully. Sep 03 11:57:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-62e03b94-875b-4fec-b2c0-63252f655801 tempest-AttachVolumeTestJSON-1352568732 None] Lock "cinder-724eb31f-8331-4468-8752-bf3c8de077e3-delete_volume" released by "delete_volume" :: held 1.477s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Acquiring lock "cinder-bcb28b41-4dc7-4503-976f-c9b02eab66ae-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-bcb28b41-4dc7-4503-976f-c9b02eab66ae-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Acquiring lock "cinder-quobyte-bcb28b41-4dc7-4503-976f-c9b02eab66ae" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-quobyte-bcb28b41-4dc7-4503-976f-c9b02eab66ae" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ae0475b-3a3e-43e4-8893-4f707eb0a25d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:22 devstack sudo[95721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae Sep 03 11:57:22 devstack sudo[95721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:22 devstack sudo[95721]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae" returned: 0 in 0.478s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:22 devstack sudo[95727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae Sep 03 11:57:22 devstack sudo[95727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:23 devstack sudo[95727]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb28b41-4dc7-4503-976f-c9b02eab66ae" returned: 0 in 0.372s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-quobyte-bcb28b41-4dc7-4503-976f-c9b02eab66ae" released by "delete_volume" :: held 0.902s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Created reservations ['286ec338-9d4d-450f-b8b7-4bec87a83d2e', '6bc8cb7f-a8af-4ca6-b270-ac9fe8a8230d', '3c1fdd11-9cec-4d0f-a997-5de987f18959', '524ea203-311d-41f3-bf62-c8ce72079772'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:23 devstack sudo[95734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:23 devstack sudo[95734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:23 devstack sudo[95734]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.258s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Deleted volume successfully. Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d3f03eda-2b35-4cf6-b159-4b8027f60fb6 tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-bcb28b41-4dc7-4503-976f-c9b02eab66ae-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Flow 'volume_create_manager' (72ea90b1-4239-4bcf-b045-23f9a5c1baf0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdd275c-214d-4761-ba19-345030a1834d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cdd275c-214d-4761-ba19-345030a1834d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1417142422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79fd45c-82ff-482c-9a39-10c773aff50c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2accdafc1b34f98b86d4e4bf12830b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:24Z,use_quota=True,user_id='de4ed9b235b144608dcb7e08994e83a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b87fed-8b07-45b3-b378-34bcd7fa3e84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9b87fed-8b07-45b3-b378-34bcd7fa3e84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc8d55b-1085-40bb-b265-cfdc5f479c0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fc8d55b-1085-40bb-b265-cfdc5f479c0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e79fd45c-82ff-482c-9a39-10c773aff50c', 'volume_name': 'volume-e79fd45c-82ff-482c-9a39-10c773aff50c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98782e75-501e-40e0-b9e4-349a815dad98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (98782e75-501e-40e0-b9e4-349a815dad98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f79702-55eb-4f3f-b7de-8b2e398f60dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Volume e79fd45c-82ff-482c-9a39-10c773aff50c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e79fd45c-82ff-482c-9a39-10c773aff50c', 'volume_size': 1} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1417142422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e79fd45c-82ff-482c-9a39-10c773aff50c,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2accdafc1b34f98b86d4e4bf12830b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:24Z,use_quota=True,user_id='de4ed9b235b144608dcb7e08994e83a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Creating volume e79fd45c-82ff-482c-9a39-10c773aff50c {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:23 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:23 devstack sudo[95738]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c 1073741824 Sep 03 11:57:23 devstack sudo[95738]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:24 devstack sudo[95738]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c 1073741824" returned: 0 in 0.641s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:24 devstack sudo[95746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c Sep 03 11:57:24 devstack sudo[95746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:24 devstack sudo[95746]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c" returned: 0 in 0.355s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] <== create_volume: return (1060ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.063s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (94f79702-55eb-4f3f-b7de-8b2e398f60dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e79fd45c-82ff-482c-9a39-10c773aff50c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6ebabe-f288-4307-9ab6-43c411cd7963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=121,cinder:UPDATE=156,cinder:DELETE=14,cinder:INSERT=32 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:57:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Volume volume-e79fd45c-82ff-482c-9a39-10c773aff50c (e79fd45c-82ff-482c-9a39-10c773aff50c): created successfully Sep 03 11:57:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f6ebabe-f288-4307-9ab6-43c411cd7963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Flow 'volume_create_manager' (72ea90b1-4239-4bcf-b045-23f9a5c1baf0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-11ade509-135a-4f44-9d29-a44ed7d7fe24 tempest-VolumesTestJSON-1622223144 None] Created volume successfully. Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Flow 'volume_create_manager' (165d3014-24ff-402f-bfad-d10fbed98812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554b376b-576b-4c44-a775-c021ca2bb704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554b376b-576b-4c44-a775-c021ca2bb704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1966624422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798ba6a2-4af7-44dd-a4e9-628b73b1aeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99b6bf79aa64252976334a70b11f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:25Z,use_quota=True,user_id='3c0dfb387e2b43d19edfb85510ed3eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a0501d-64c6-47c4-a4ad-5c24dbc2843a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9a0501d-64c6-47c4-a4ad-5c24dbc2843a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0c554e-4ef3-4be6-95d6-19e18d3870a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (db0c554e-4ef3-4be6-95d6-19e18d3870a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '798ba6a2-4af7-44dd-a4e9-628b73b1aeef', 'volume_name': 'volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b86670c-ef51-4806-9dba-a65e7f1e0fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b86670c-ef51-4806-9dba-a65e7f1e0fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0c5e24-28f8-4de3-97e4-05eeebd08174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Volume 798ba6a2-4af7-44dd-a4e9-628b73b1aeef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef', 'volume_size': 1} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1966624422',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=798ba6a2-4af7-44dd-a4e9-628b73b1aeef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a99b6bf79aa64252976334a70b11f2b3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:25Z,use_quota=True,user_id='3c0dfb387e2b43d19edfb85510ed3eb0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Creating volume 798ba6a2-4af7-44dd-a4e9-628b73b1aeef {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:25 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:25 devstack sudo[95749]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef 1073741824 Sep 03 11:57:25 devstack sudo[95749]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:25 devstack sudo[95749]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef 1073741824" returned: 0 in 0.467s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:25 devstack sudo[95755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef Sep 03 11:57:25 devstack sudo[95755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:25 devstack sudo[95755]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef" returned: 0 in 0.267s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] <== create_volume: return (789ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.793s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0c5e24-28f8-4de3-97e4-05eeebd08174) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30def487-674e-40a9-910f-5408c606f350) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Volume volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef (798ba6a2-4af7-44dd-a4e9-628b73b1aeef): created successfully Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (30def487-674e-40a9-910f-5408c606f350) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Flow 'volume_create_manager' (165d3014-24ff-402f-bfad-d10fbed98812) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-39234c59-97f0-4c66-9085-72a30ec0baaa tempest-VolumesTransfersV357Test-1483008676 None] Created volume successfully. Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Flow 'volume_create_manager' (8a16e52f-933a-4407-bea1-aa6e992b9185) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a201902-b64f-43a1-acce-5651a5344a6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a201902-b64f-43a1-acce-5651a5344a6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-781135553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f8b49a-6c68-44ce-8cce-c23e6928fbb9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2accdafc1b34f98b86d4e4bf12830b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:26Z,use_quota=True,user_id='de4ed9b235b144608dcb7e08994e83a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e286e7-20aa-4a32-b72a-bf9ff93ab92c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76e286e7-20aa-4a32-b72a-bf9ff93ab92c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20510b59-6c60-435c-9e4d-f5acc836cca4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20510b59-6c60-435c-9e4d-f5acc836cca4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '36f8b49a-6c68-44ce-8cce-c23e6928fbb9', 'volume_name': 'volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42ca452-ae72-4b68-b4f5-5e4c982b6590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d42ca452-ae72-4b68-b4f5-5e4c982b6590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4722198b-9897-43c8-ab6f-f24cadf250cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Volume 36f8b49a-6c68-44ce-8cce-c23e6928fbb9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9', 'volume_size': 1} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-781135553',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=36f8b49a-6c68-44ce-8cce-c23e6928fbb9,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2accdafc1b34f98b86d4e4bf12830b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:26Z,use_quota=True,user_id='de4ed9b235b144608dcb7e08994e83a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Creating volume 36f8b49a-6c68-44ce-8cce-c23e6928fbb9 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:26 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:26 devstack sudo[95758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 1073741824 Sep 03 11:57:26 devstack sudo[95758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Acquiring lock "cinder-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "cinder-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Acquiring lock "cinder-quobyte-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "cinder-quobyte-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[46416f78-fc94-4829-a5b1-72c5f7b5abd5]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:27 devstack sudo[95760]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 Sep 03 11:57:27 devstack sudo[95760]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:27 devstack sudo[95758]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 1073741824" returned: 0 in 0.669s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:27 devstack sudo[95760]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4" returned: 0 in 0.470s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:27 devstack sudo[95769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 Sep 03 11:57:27 devstack sudo[95769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:27 devstack sudo[95770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4 Sep 03 11:57:27 devstack sudo[95770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Acquiring lock "cinder-798ba6a2-4af7-44dd-a4e9-628b73b1aeef-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-798ba6a2-4af7-44dd-a4e9-628b73b1aeef-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Acquiring lock "cinder-quobyte-798ba6a2-4af7-44dd-a4e9-628b73b1aeef" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-quobyte-798ba6a2-4af7-44dd-a4e9-628b73b1aeef" acquired by "delete_volume" :: waited 0.045s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:27 devstack sudo[95769]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:27 devstack sudo[95770]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9" returned: 0 in 0.419s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] <== create_volume: return (1162ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[169d7d33-d94e-4e8d-8ad1-de0ad05cf489]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "cinder-quobyte-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4" released by "delete_volume" :: held 0.928s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4722198b-9897-43c8-ab6f-f24cadf250cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42c6607-1d29-4e62-8f79-d280161779b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:27 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Volume volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 (36f8b49a-6c68-44ce-8cce-c23e6928fbb9): created successfully Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a42c6607-1d29-4e62-8f79-d280161779b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Flow 'volume_create_manager' (8a16e52f-933a-4407-bea1-aa6e992b9185) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:27 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef Sep 03 11:57:27 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b417500d-175b-4f7f-a462-d098a4e0b120 tempest-VolumesTestJSON-1622223144 None] Created volume successfully. Sep 03 11:57:27 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Created reservations ['6877f505-e3f1-435b-8063-6f988d4a39f4', 'eb8134ac-5881-4eca-bf47-aef8e36f686d', 'dd06d02d-e765-4f44-8a9f-cfbb64599cb4', 'ffb1b3b3-9a65-48b0-9f25-94b6e232a032'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:28 devstack sudo[95778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:28 devstack sudo[95778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:28 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef" returned: 0 in 0.426s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:28 devstack sudo[95783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef Sep 03 11:57:28 devstack sudo[95783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:28 devstack sudo[95778]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.264s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Deleted volume successfully. Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7978f618-1e65-455e-a3dd-e4354d5d2731 tempest-AttachVolumeShelveTestJSON-2010647015 None] Lock "cinder-d7c7bc52-339c-41f3-a87d-f2e4bd4044c4-delete_volume" released by "delete_volume" :: held 1.578s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:28 devstack sudo[95783]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-798ba6a2-4af7-44dd-a4e9-628b73b1aeef" returned: 0 in 0.260s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-quobyte-798ba6a2-4af7-44dd-a4e9-628b73b1aeef" released by "delete_volume" :: held 0.746s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Created reservations ['62d16634-2566-44ae-8cd2-ea66d355116f', '32f11e72-f4e4-40a9-a39b-8c8a29c2293a', 'ffe2d53e-4966-42f3-940a-dc0569a715b6', 'f6a2818f-cb14-411a-91bc-4156ffc65ec8'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:28 devstack sudo[95787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:28 devstack sudo[95787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:28 devstack sudo[95787]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.340s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:28 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Deleted volume successfully. Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0b01814-f75e-4d89-bd9d-9050d34f6c7e tempest-VolumesTransfersV357Test-818416055 None] Lock "cinder-798ba6a2-4af7-44dd-a4e9-628b73b1aeef-delete_volume" released by "delete_volume" :: held 1.424s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Flow 'volume_create_manager' (48ae1eaa-525b-42dd-8eaa-3e697828dcf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e7a876-a9b5-4eb3-b732-af61fa4cfaab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78e7a876-a9b5-4eb3-b732-af61fa4cfaab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-563458752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7093798f-c550-4661-9e84-b9a5bbfcdb33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2accdafc1b34f98b86d4e4bf12830b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:29Z,use_quota=True,user_id='de4ed9b235b144608dcb7e08994e83a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0cb597-21a9-45d3-bd60-0a7b1aeabb41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2e0cb597-21a9-45d3-bd60-0a7b1aeabb41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e2e3df-ded2-4d8f-82d8-37a43ec0d28b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e2e3df-ded2-4d8f-82d8-37a43ec0d28b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7093798f-c550-4661-9e84-b9a5bbfcdb33', 'volume_name': 'volume-7093798f-c550-4661-9e84-b9a5bbfcdb33', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7ef9f8-5527-478d-91e5-f355dea5e9a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8a7ef9f8-5527-478d-91e5-f355dea5e9a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af65352d-8a72-4c9a-a972-96172cff1c36) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Volume 7093798f-c550-4661-9e84-b9a5bbfcdb33: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7093798f-c550-4661-9e84-b9a5bbfcdb33', 'volume_size': 1} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-563458752',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7093798f-c550-4661-9e84-b9a5bbfcdb33,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='e2accdafc1b34f98b86d4e4bf12830b8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:29Z,use_quota=True,user_id='de4ed9b235b144608dcb7e08994e83a5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Creating volume 7093798f-c550-4661-9e84-b9a5bbfcdb33 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:29 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:29 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 1073741824 Sep 03 11:57:29 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:29 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 1073741824" returned: 0 in 0.589s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:30 devstack sudo[95796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 Sep 03 11:57:30 devstack sudo[95796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:30 devstack sudo[95796]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33" returned: 0 in 0.377s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] <== create_volume: return (1023ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.026s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af65352d-8a72-4c9a-a972-96172cff1c36) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7093798f-c550-4661-9e84-b9a5bbfcdb33', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9058068d-f99c-438c-a1ff-541804abd129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:30 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Volume volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 (7093798f-c550-4661-9e84-b9a5bbfcdb33): created successfully Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9058068d-f99c-438c-a1ff-541804abd129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Flow 'volume_create_manager' (48ae1eaa-525b-42dd-8eaa-3e697828dcf8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-44de4a87-cfaf-4652-aabe-c918b84af6fd tempest-VolumesTestJSON-1622223144 None] Created volume successfully. Sep 03 11:57:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-95b9e592-7bb5-490f-a810-3d5829b6e2b2 tempest-BackendsCapabilitiesAdminTestsJSON-990328149 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.850830078125, 'free_capacity_gb': 1773.850830078125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87256) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:57:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d02a671e-1c29-4db1-b9f0-75dffaac779a tempest-BackendsCapabilitiesAdminTestsJSON-990328149 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.850830078125, 'free_capacity_gb': 1773.850830078125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87256) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Acquiring lock "cinder-7093798f-c550-4661-9e84-b9a5bbfcdb33-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Lock "cinder-7093798f-c550-4661-9e84-b9a5bbfcdb33-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Acquiring lock "cinder-quobyte-7093798f-c550-4661-9e84-b9a5bbfcdb33" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Lock "cinder-quobyte-7093798f-c550-4661-9e84-b9a5bbfcdb33" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a83e0e18-b59f-4442-8da4-ee90e4dcacbc]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:33 devstack sudo[95803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 Sep 03 11:57:33 devstack sudo[95803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:33 devstack sudo[95803]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33" returned: 0 in 0.414s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:33 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33 Sep 03 11:57:33 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:33 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7093798f-c550-4661-9e84-b9a5bbfcdb33" returned: 0 in 0.251s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Lock "cinder-quobyte-7093798f-c550-4661-9e84-b9a5bbfcdb33" released by "delete_volume" :: held 0.709s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Created reservations ['49968f10-1789-4902-8b7b-b99821447fc7', '48471ac2-0ba3-4042-ad1a-558bc43dcff8', '5a5b016a-472d-4941-aec4-b207238c4ea6', 'e11da151-8ee3-432c-b1a0-d5fe9dad0865'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:34 devstack sudo[95811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:34 devstack sudo[95811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:34 devstack sudo[95811]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Acquiring lock "cinder-36f8b49a-6c68-44ce-8cce-c23e6928fbb9-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.363s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Deleted volume successfully. Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Lock "cinder-36f8b49a-6c68-44ce-8cce-c23e6928fbb9-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-06d5ddd2-54a0-4960-bb5e-04fd220bff5b tempest-VolumesTestJSON-1622223144 None] Lock "cinder-7093798f-c550-4661-9e84-b9a5bbfcdb33-delete_volume" released by "delete_volume" :: held 1.350s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Acquiring lock "cinder-quobyte-36f8b49a-6c68-44ce-8cce-c23e6928fbb9" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Lock "cinder-quobyte-36f8b49a-6c68-44ce-8cce-c23e6928fbb9" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[99b39f7f-c227-47a9-af54-6e27f6796a64]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:34 devstack sudo[95814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 Sep 03 11:57:34 devstack sudo[95814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:35 devstack sudo[95814]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9" returned: 0 in 0.441s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:35 devstack sudo[95820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9 Sep 03 11:57:35 devstack sudo[95820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:35 devstack sudo[95820]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-36f8b49a-6c68-44ce-8cce-c23e6928fbb9" returned: 0 in 0.303s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Lock "cinder-quobyte-36f8b49a-6c68-44ce-8cce-c23e6928fbb9" released by "delete_volume" :: held 0.792s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Created reservations ['82ac2be6-ca70-4d0d-a1f4-6f044d5dfcfd', '6631fb77-fd47-409b-9f15-df416036cb69', '2b4e35bb-997c-43ff-b80b-1ab27c3b014c', '80104a0e-5d4e-497d-9f82-3ea29c17e1b6'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:35 devstack sudo[95823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:35 devstack sudo[95823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Acquiring lock "cinder-e79fd45c-82ff-482c-9a39-10c773aff50c-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Lock "cinder-e79fd45c-82ff-482c-9a39-10c773aff50c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Acquiring lock "cinder-quobyte-e79fd45c-82ff-482c-9a39-10c773aff50c" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Lock "cinder-quobyte-e79fd45c-82ff-482c-9a39-10c773aff50c" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0acd01a0-bc95-405c-9560-ff32c64f858b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:35 devstack sudo[95823]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.475s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:35 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Deleted volume successfully. Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f83154f-9ee9-45fd-8708-7f6a4b7a7e12 tempest-VolumesTestJSON-1622223144 None] Lock "cinder-36f8b49a-6c68-44ce-8cce-c23e6928fbb9-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:36 devstack sudo[95825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c Sep 03 11:57:36 devstack sudo[95825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:36 devstack sudo[95825]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c" returned: 0 in 0.539s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:36 devstack sudo[95833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c Sep 03 11:57:36 devstack sudo[95833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:36 devstack sudo[95833]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e79fd45c-82ff-482c-9a39-10c773aff50c" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Lock "cinder-quobyte-e79fd45c-82ff-482c-9a39-10c773aff50c" released by "delete_volume" :: held 0.883s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Created reservations ['44834d43-33d7-4e90-a0b8-6c0e83be70e6', '513da431-ee1d-4886-a563-bf4ec0902a5b', '94859e0c-1752-4e82-9f01-6ce3325a0fae', '728ad3b1-4167-451c-90fb-575944332995'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:36 devstack sudo[95836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:57:36 devstack sudo[95836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:37 devstack sudo[95836]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.344s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:37 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:57:37 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Deleted volume successfully. Sep 03 11:57:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a96052f6-9ff0-438e-b715-bf126768e1cc tempest-VolumesTestJSON-1622223144 None] Lock "cinder-e79fd45c-82ff-482c-9a39-10c773aff50c-delete_volume" released by "delete_volume" :: held 1.541s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:57:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c75a1b02-addb-4b58-bb6e-ec3a41a21d7a tempest-GroupSnapshotsTest-1733960627 None] Group tempest-GroupSnapshotsTest-Group-1934745870: creating Sep 03 11:57:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c75a1b02-addb-4b58-bb6e-ec3a41a21d7a tempest-GroupSnapshotsTest-1733960627 None] Group tempest-GroupSnapshotsTest-Group-1934745870: created successfully Sep 03 11:57:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c75a1b02-addb-4b58-bb6e-ec3a41a21d7a tempest-GroupSnapshotsTest-1733960627 None] Create group completed successfully. Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (5b50f932-d3a4-4ec9-8479-86eca9d485aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bab14d-0b8c-42bf-8349-7bb703191fc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7bab14d-0b8c-42bf-8349-7bb703191fc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-889829635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7275240e-3da1-4ed1-82dc-ee58e9eb2e96,host='devstack@QuobyteHD#QuobyteHD',id=98904788-7322-4c6c-9e5e-e416b7ca99bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:45Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e576ac20-99a0-41a0-be2b-797dde8b27fd),volume_type_id=e576ac20-99a0-41a0-be2b-797dde8b27fd)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a836100-9231-4387-8600-17eb3915d090) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a836100-9231-4387-8600-17eb3915d090) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5767a163-9c49-4a2a-9124-db4e2b98a8bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5767a163-9c49-4a2a-9124-db4e2b98a8bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '98904788-7322-4c6c-9e5e-e416b7ca99bd', 'volume_name': 'volume-98904788-7322-4c6c-9e5e-e416b7ca99bd', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb0d97a-8dcf-4526-905c-3b54a8c8c1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3eb0d97a-8dcf-4526-905c-3b54a8c8c1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35578f5c-3a2b-454a-b932-b3c2c1aeef43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:45 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Volume 98904788-7322-4c6c-9e5e-e416b7ca99bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-98904788-7322-4c6c-9e5e-e416b7ca99bd', 'volume_size': 1} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7275240e-3da1-4ed1-82dc-ee58e9eb2e96,created_at=2026-09-03T09:57:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-889829635',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7275240e-3da1-4ed1-82dc-ee58e9eb2e96,host='devstack@QuobyteHD#QuobyteHD',id=98904788-7322-4c6c-9e5e-e416b7ca99bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:45Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(e576ac20-99a0-41a0-be2b-797dde8b27fd),volume_type_id=e576ac20-99a0-41a0-be2b-797dde8b27fd)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Creating volume 98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:45 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:45 devstack sudo[95847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd 1073741824 Sep 03 11:57:45 devstack sudo[95847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:46 devstack sudo[95847]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd 1073741824" returned: 0 in 0.711s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:46 devstack sudo[95852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd Sep 03 11:57:46 devstack sudo[95852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:46 devstack sudo[95852]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd" returned: 0 in 0.401s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] <== create_volume: return (1180ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (35578f5c-3a2b-454a-b932-b3c2c1aeef43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-98904788-7322-4c6c-9e5e-e416b7ca99bd', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc2818e-026e-42f9-9ac6-2cf1e6a25a8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Volume volume-98904788-7322-4c6c-9e5e-e416b7ca99bd (98904788-7322-4c6c-9e5e-e416b7ca99bd): created successfully Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3dc2818e-026e-42f9-9ac6-2cf1e6a25a8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (5b50f932-d3a4-4ec9-8479-86eca9d485aa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-57b55419-d2f1-4911-a4f2-52e765c48377 tempest-GroupSnapshotsTest-1733960627 None] Created volume successfully. Sep 03 11:57:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] GroupSnapshot 89db8a6c-2c6f-42f4-93fb-80b33047d140: creating. Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Group snapshot 89db8a6c-2c6f-42f4-93fb-80b33047d140: creating. {{(pid=87256) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Creating offline snapshot 93c4f7ba-70b0-44c9-9977-fe26d51b514b of volume 98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe36197-4a79-4a82-aec1-ddf22bd039b1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:48 devstack sudo[95855]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd Sep 03 11:57:48 devstack sudo[95855]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:48 devstack sudo[95855]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd" returned: 0 in 0.537s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:48 devstack sudo[95860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b 1G Sep 03 11:57:48 devstack sudo[95860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:49 devstack sudo[95860]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b 1G" returned: 0 in 0.521s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98904788-7322-4c6c-9e5e-e416b7ca99bd -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:49 devstack sudo[95866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98904788-7322-4c6c-9e5e-e416b7ca99bd -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b Sep 03 11:57:49 devstack sudo[95866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Flow 'volume_create_manager' (02db444f-76aa-4675-959c-cab59f3778a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e7a0f2-bb34-4389-a455-e7270dd68a84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8e7a0f2-bb34-4389-a455-e7270dd68a84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272199796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598f537dea9f42709d90d420f9085527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:50Z,use_quota=True,user_id='2d205126f6734588aa0b8bba4d9928ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:49 devstack sudo[95866]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2391e618-200e-4e80-bac1-71f93f2844e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2391e618-200e-4e80-bac1-71f93f2844e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3959eb64-fe81-47fa-b3e1-f46bc7b9fa18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3959eb64-fe81-47fa-b3e1-f46bc7b9fa18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2', 'volume_name': 'volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103b0b7a-7edf-4a76-b82d-9990b65bd772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (103b0b7a-7edf-4a76-b82d-9990b65bd772) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd309ab6-829c-4936-a4ec-0e5f93a06826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Volume 01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2', 'volume_size': 1} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-98904788-7322-4c6c-9e5e-e416b7ca99bd -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b" returned: 0 in 0.471s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:49 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:57:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:49 devstack sudo[95872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b Sep 03 11:57:49 devstack sudo[95872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:50 devstack sudo[95872]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:50 devstack sudo[95875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.info Sep 03 11:57:50 devstack sudo[95875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:50 devstack sudo[95875]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.info" returned: 0 in 0.304s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:50 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:50 devstack sudo[95878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.info Sep 03 11:57:50 devstack sudo[95878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:50 devstack sudo[95878]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.info" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.487s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.905s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:57:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-272199796',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='598f537dea9f42709d90d420f9085527',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:57:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:57:50Z,use_quota=True,user_id='2d205126f6734588aa0b8bba4d9928ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Creating volume 01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:50 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:57:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:50 devstack sudo[95881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 1073741824 Sep 03 11:57:50 devstack sudo[95881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-11773f1a-2070-4110-ba1b-1107594d5403 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 89db8a6c-2c6f-42f4-93fb-80b33047d140: created successfully Sep 03 11:57:51 devstack sudo[95881]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 1073741824" returned: 0 in 0.479s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:51 devstack sudo[95886]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:57:51 devstack sudo[95886]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:51 devstack sudo[95886]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.273s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd309ab6-829c-4936-a4ec-0e5f93a06826) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f981263d-c60f-4bca-afbe-3868899cb027) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:57:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Volume volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 (01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2): created successfully Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f981263d-c60f-4bca-afbe-3868899cb027) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:57:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Flow 'volume_create_manager' (02db444f-76aa-4675-959c-cab59f3778a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:57:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b0d7bf0b-17c5-4a7c-82de-85e56ef8bd42 tempest-VolumesActionsTest-93586440 None] Created volume successfully. Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-93c4f7ba-70b0-44c9-9977-fe26d51b514b-279c2c15-ef63-4142-9935-081ac3081f23" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-93c4f7ba-70b0-44c9-9977-fe26d51b514b-279c2c15-ef63-4142-9935-081ac3081f23" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Creating volume 279c2c15-ef63-4142-9935-081ac3081f23 from snapshot 93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-279c2c15-ef63-4142-9935-081ac3081f23" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-279c2c15-ef63-4142-9935-081ac3081f23" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] snapshot: 93c4f7ba-70b0-44c9-9977-fe26d51b514b, volume: 279c2c15-ef63-4142-9935-081ac3081f23, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[66a14304-413b-4d24-ad94-4884f9e88fab]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:52 devstack sudo[95890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b Sep 03 11:57:52 devstack sudo[95890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:53 devstack sudo[95890]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b" returned: 0 in 0.594s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98904788-7322-4c6c-9e5e-e416b7ca99bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3661cc2-ba5b-4c8f-b2af-9e1e6a6770b2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:53 devstack sudo[95899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd Sep 03 11:57:53 devstack sudo[95899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:57:53 devstack sudo[95899]: pam_unix(sudo:session): session closed for user root Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd" returned: 0 in 0.589s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:57:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:57:53 devstack sudo[95904]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 Sep 03 11:57:53 devstack sudo[95904]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:00 devstack sudo[95904]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23" returned: 0 in 6.576s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:00 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd, size 1024.00 MB, duration 6.58 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:58:00 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Converted 1024.00 MB image at 155.66 MB/s Sep 03 11:58:00 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:58:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:00 devstack sudo[95947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 Sep 03 11:58:00 devstack sudo[95947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:00 devstack sudo[95947]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23" returned: 0 in 0.386s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-279c2c15-ef63-4142-9935-081ac3081f23" released by "_copy_volume_from_snapshot" :: held 8.308s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-93c4f7ba-70b0-44c9-9977-fe26d51b514b-279c2c15-ef63-4142-9935-081ac3081f23" released by "_create_volume_from_snapshot" :: held 8.403s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.434s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4e74c795-2a7e-442c-a952-2d26ba9358d7 tempest-GroupSnapshotsTest-1733960627 None] Create group from source-snapshot-89db8a6c-2c6f-42f4-93fb-80b33047d140 completed successfully. Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Flow 'volume_create_manager' (0897c496-75e9-48b9-8ad7-9fb1c63d587b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668de412-363e-4265-9327-19302fc55165) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (668de412-363e-4265-9327-19302fc55165) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1040634036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66289b4e-559b-4dc3-9550-ba6dcca600d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0170a101c6c6420aac89510f5bf45f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:02Z,use_quota=True,user_id='544db818c5aa45d282d230d417370308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29977a5-43e6-4175-afa6-01f3d2e54bcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29977a5-43e6-4175-afa6-01f3d2e54bcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9510b0c1-a357-467f-ba2c-77319e87f37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9510b0c1-a357-467f-ba2c-77319e87f37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66289b4e-559b-4dc3-9550-ba6dcca600d5', 'volume_name': 'volume-66289b4e-559b-4dc3-9550-ba6dcca600d5', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba75cde3-0c53-4c7f-8b60-fff7ad8df7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ba75cde3-0c53-4c7f-8b60-fff7ad8df7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167764b2-b40c-4d86-8d11-45ba511672f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:02 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Volume 66289b4e-559b-4dc3-9550-ba6dcca600d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66289b4e-559b-4dc3-9550-ba6dcca600d5', 'volume_size': 1} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-1040634036',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66289b4e-559b-4dc3-9550-ba6dcca600d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0170a101c6c6420aac89510f5bf45f08',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:02Z,use_quota=True,user_id='544db818c5aa45d282d230d417370308',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Creating volume 66289b4e-559b-4dc3-9550-ba6dcca600d5 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:58:02 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:58:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:02 devstack sudo[95986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 1073741824 Sep 03 11:58:02 devstack sudo[95986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:03 devstack sudo[95986]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 1073741824" returned: 0 in 0.967s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-279c2c15-ef63-4142-9935-081ac3081f23" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-279c2c15-ef63-4142-9935-081ac3081f23" acquired by "delete_volume" :: waited 0.046s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3891453-865a-436e-9741-c22ded358397]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:03 devstack sudo[96022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 Sep 03 11:58:03 devstack sudo[96022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:03 devstack sudo[96023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 Sep 03 11:58:03 devstack sudo[96023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:04 devstack sudo[96022]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5" returned: 0 in 0.599s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] <== create_volume: return (1744ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.747s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (167764b2-b40c-4d86-8d11-45ba511672f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66289b4e-559b-4dc3-9550-ba6dcca600d5', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324dd086-93ec-4fd3-911c-ffb2a2d908bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:04 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Volume volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 (66289b4e-559b-4dc3-9550-ba6dcca600d5): created successfully Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (324dd086-93ec-4fd3-911c-ffb2a2d908bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Flow 'volume_create_manager' (0897c496-75e9-48b9-8ad7-9fb1c63d587b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:04 devstack sudo[96023]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23" returned: 0 in 0.694s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-538d3cee-2b54-47d8-a255-055df47ad0a1 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Created volume successfully. Sep 03 11:58:04 devstack sudo[96033]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23 Sep 03 11:58:04 devstack sudo[96033]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:04 devstack sudo[96033]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-279c2c15-ef63-4142-9935-081ac3081f23" returned: 0 in 0.305s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-279c2c15-ef63-4142-9935-081ac3081f23" released by "delete_volume" :: held 1.092s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['748c554f-a99c-4eae-a227-a335bd824986'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:04 devstack cinder-volume[87256]: WARNING cinder.quota [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-2105565705 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-2105565705, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:58:04 devstack cinder-volume[87256]: WARNING cinder.quota [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-2105565705 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-2105565705, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['50422b61-641d-421e-86dc-9cbfe8451fd5', 'f232167d-fcbd-46db-b214-b838d6d9ee5b', '7295543f-df7e-4278-809c-abd2fe299d9d', 'a604a364-c49c-478e-aa53-a4191d89045a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:04 devstack sudo[96036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:58:04 devstack sudo[96036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2a456cbc-f9e0-4d4d-b91a-83e95b7c8ec5 tempest-VolumesActionsTest-93586440 None] Acquiring lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" by "attach_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2a456cbc-f9e0-4d4d-b91a-83e95b7c8ec5 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" acquired by "attach_volume" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2a456cbc-f9e0-4d4d-b91a-83e95b7c8ec5 tempest-VolumesActionsTest-93586440 None] Attaching volume 01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 to instance 50c3e581-abef-4a19-8267-80d2f6199256 at mountpoint /dev/vdb on host None. Sep 03 11:58:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2a456cbc-f9e0-4d4d-b91a-83e95b7c8ec5 tempest-VolumesActionsTest-93586440 None] Attach volume completed successfully. Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2a456cbc-f9e0-4d4d-b91a-83e95b7c8ec5 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" released by "attach_volume" :: held 0.157s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:05 devstack sudo[96036]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.378s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:58:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-383ca6fe-9f73-4ebd-beb0-f5a01fda6631 tempest-GroupSnapshotsTest-1733960627 None] Delete group completed successfully. Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-22a773a7-b4f8-435c-ab1b-20f76d88a106 tempest-VolumesActionsTest-93586440 None] Acquiring lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-detach_volume" by "detach_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-22a773a7-b4f8-435c-ab1b-20f76d88a106 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-22a773a7-b4f8-435c-ab1b-20f76d88a106 tempest-VolumesActionsTest-93586440 None] Detaching volume 01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 from instance 50c3e581-abef-4a19-8267-80d2f6199256. Sep 03 11:58:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-22a773a7-b4f8-435c-ab1b-20f76d88a106 tempest-VolumesActionsTest-93586440 None] Detach volume completed successfully. Sep 03 11:58:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-22a773a7-b4f8-435c-ab1b-20f76d88a106 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-detach_volume" released by "detach_volume" :: held 0.073s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Flow 'volume_create_manager' (df9fd5d7-ee94-4d59-af4a-f2e23d72a4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920fc7aa-4b9c-45c5-8ee3-9a4f21a86406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 89db8a6c-2c6f-42f4-93fb-80b33047d140: deleting Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (920fc7aa-4b9c-45c5-8ee3-9a4f21a86406) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-169637629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ec42e5-5483-4edc-aee3-6616aac0a6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42f89cf1d142a29a369fb6f8d66225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:07Z,use_quota=True,user_id='d19fe5a3c32d4bca96372d216a308ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34bc5b32-28a6-4693-975e-e2260c4b911b),volume_type_id=34bc5b32-28a6-4693-975e-e2260c4b911b)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9738b920-1a52-4a89-b98c-e081598c15e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9738b920-1a52-4a89-b98c-e081598c15e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dee830-97d3-440c-9055-e02ab8c73d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (94dee830-97d3-440c-9055-e02ab8c73d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78ec42e5-5483-4edc-aee3-6616aac0a6ab', 'volume_name': 'volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b3f546-e5a8-45cc-a971-566a44f47c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72b3f546-e5a8-45cc-a971-566a44f47c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86c420-e861-49a4-8af1-acf8917bf5e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:06 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Volume 78ec42e5-5483-4edc-aee3-6616aac0a6ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab', 'volume_size': 1} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-169637629',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78ec42e5-5483-4edc-aee3-6616aac0a6ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6b42f89cf1d142a29a369fb6f8d66225',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:07Z,use_quota=True,user_id='d19fe5a3c32d4bca96372d216a308ff1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(34bc5b32-28a6-4693-975e-e2260c4b911b),volume_type_id=34bc5b32-28a6-4693-975e-e2260c4b911b)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Creating volume 78ec42e5-5483-4edc-aee3-6616aac0a6ab {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:58:06 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Acquiring lock "cinder-66289b4e-559b-4dc3-9550-ba6dcca600d5-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:06 devstack sudo[96059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab 1073741824 Sep 03 11:58:06 devstack sudo[96059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 89db8a6c-2c6f-42f4-93fb-80b33047d140: deleting {{(pid=87256) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "cinder-66289b4e-559b-4dc3-9550-ba6dcca600d5-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-98904788-7322-4c6c-9e5e-e416b7ca99bd" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-98904788-7322-4c6c-9e5e-e416b7ca99bd" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-93c4f7ba-70b0-44c9-9977-fe26d51b514b" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-93c4f7ba-70b0-44c9-9977-fe26d51b514b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Deleting offline snapshot 93c4f7ba-70b0-44c9-9977-fe26d51b514b of volume 98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] snapshot_file for this snap is: volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Acquiring lock "cinder-quobyte-66289b4e-559b-4dc3-9550-ba6dcca600d5" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "cinder-quobyte-66289b4e-559b-4dc3-9550-ba6dcca600d5" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae71996-5079-41cd-a6f4-24c18f898db7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[653d8f61-fb35-4e13-8132-ea49ee6d5fce]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:07 devstack sudo[96063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 Sep 03 11:58:07 devstack sudo[96063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:07 devstack sudo[96062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b Sep 03 11:58:07 devstack sudo[96062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:07 devstack sudo[96062]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b" returned: 0 in 0.470s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-98904788-7322-4c6c-9e5e-e416b7ca99bd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:58:07 devstack sudo[96059]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:07 devstack sudo[96063]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab 1073741824" returned: 0 in 0.704s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5" returned: 0 in 0.475s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a864f24d-01fd-41ad-a65d-e7ad84dcba8c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:07 devstack sudo[96076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5 Sep 03 11:58:07 devstack sudo[96076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:07 devstack sudo[96079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab Sep 03 11:58:07 devstack sudo[96079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:07 devstack sudo[96077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd Sep 03 11:58:07 devstack sudo[96077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:08 devstack sudo[96076]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-66289b4e-559b-4dc3-9550-ba6dcca600d5" returned: 0 in 0.433s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:08 devstack sudo[96079]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "cinder-quobyte-66289b4e-559b-4dc3-9550-ba6dcca600d5" released by "delete_volume" :: held 0.968s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab" returned: 0 in 0.378s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c86c420-e861-49a4-8af1-acf8917bf5e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76273aff-e54f-4b25-a824-8ebe3e0e47f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:08 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Volume volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab (78ec42e5-5483-4edc-aee3-6616aac0a6ab): created successfully Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (76273aff-e54f-4b25-a824-8ebe3e0e47f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Flow 'volume_create_manager' (df9fd5d7-ee94-4d59-af4a-f2e23d72a4a2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-120d0ff0-ca9b-4d7d-9c4c-9e330d5225a2 tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Created volume successfully. Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Created reservations ['50dcfc3b-cd2d-4b0e-9220-e9f315585391', '0881ddb6-f907-4961-96e9-ac961174b616', '43bea69e-7ed5-4bd2-bdb0-f0492ce3bcdf', 'c2326ea3-2e5d-4d88-ae6c-cdf84794a99f'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:08 devstack sudo[96089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:58:08 devstack sudo[96089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:08 devstack sudo[96077]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd" returned: 0 in 0.739s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:08 devstack sudo[96091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b Sep 03 11:58:08 devstack sudo[96091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:08 devstack sudo[96089]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.260s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:58:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Deleted volume successfully. Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1675194-bb35-43d4-aeb9-fac560227fd8 tempest-VolumeQuotasNegativeTestJSON-1169259489 None] Lock "cinder-66289b4e-559b-4dc3-9550-ba6dcca600d5-delete_volume" released by "delete_volume" :: held 1.631s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:08 devstack sudo[96091]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b" returned: 0 in 0.408s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:08 devstack sudo[96098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b Sep 03 11:58:08 devstack sudo[96098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:09 devstack sudo[96098]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd.93c4f7ba-70b0-44c9-9977-fe26d51b514b" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-93c4f7ba-70b0-44c9-9977-fe26d51b514b" released by "_delete_snapshot" :: held 2.047s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-98904788-7322-4c6c-9e5e-e416b7ca99bd" released by "delete_snapshot" :: held 2.088s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:09 devstack sudo[96101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:58:09 devstack sudo[96101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:09 devstack cinder-volume[87256]: WARNING cinder.quota [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-2105565705 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-2105565705, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['7b80d0d6-09a1-4ced-9f29-4acaebbace4d', 'da1aff56-6153-41b9-931d-89e255c65592', '6aeb31ab-fbe9-4c0e-9d2e-8f41818cbe16', '82082ffe-1547-4b1d-845e-b3b2aebbcdfa'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-54ca7d54-b6a6-4255-901c-f61d47296549 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 89db8a6c-2c6f-42f4-93fb-80b33047d140: deleted successfully Sep 03 11:58:09 devstack sudo[96101]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.282s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:09 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:58:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1ae0d5b9-0345-4831-9740-f7652501239f tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Retype volume completed successfully. Sep 03 11:58:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Acquiring lock "cinder-78ec42e5-5483-4edc-aee3-6616aac0a6ab-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "cinder-78ec42e5-5483-4edc-aee3-6616aac0a6ab-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Acquiring lock "cinder-quobyte-78ec42e5-5483-4edc-aee3-6616aac0a6ab" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "cinder-quobyte-78ec42e5-5483-4edc-aee3-6616aac0a6ab" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:10 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3bacf242-462c-4b07-b3c5-b199cebbef46]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:11 devstack sudo[96107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab Sep 03 11:58:11 devstack sudo[96107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-98904788-7322-4c6c-9e5e-e416b7ca99bd" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-98904788-7322-4c6c-9e5e-e416b7ca99bd" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[34ae534b-d107-43ba-8dfc-be269508fb8a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:11 devstack sudo[96109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd Sep 03 11:58:11 devstack sudo[96109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:11 devstack sudo[96107]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab" returned: 0 in 0.512s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:11 devstack sudo[96114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab Sep 03 11:58:11 devstack sudo[96114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:11 devstack sudo[96109]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd" returned: 0 in 0.524s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:11 devstack sudo[96119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd Sep 03 11:58:11 devstack sudo[96119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:11 devstack sudo[96114]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-78ec42e5-5483-4edc-aee3-6616aac0a6ab" returned: 0 in 0.406s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "cinder-quobyte-78ec42e5-5483-4edc-aee3-6616aac0a6ab" released by "delete_volume" :: held 1.000s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=114,cinder:UPDATE=152,cinder:DELETE=12,cinder:INSERT=36 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:58:11 devstack cinder-volume[87256]: WARNING cinder.quota [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:58:11 devstack cinder-volume[87256]: WARNING cinder.quota [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:58:11 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Created reservations ['ad88566f-e257-4040-a207-bc12a534ce7d', 'f66189a7-dc3a-4b6a-9c03-e8b961ad894e', 'bc865d27-a50c-4dd2-932b-ccac13e09c2c', '66ae0c9c-a852-480a-8d9f-c4a93466dbdd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:12 devstack sudo[96119]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-98904788-7322-4c6c-9e5e-e416b7ca99bd" returned: 0 in 0.443s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-98904788-7322-4c6c-9e5e-e416b7ca99bd" released by "delete_volume" :: held 1.101s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:12 devstack sudo[96127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:58:12 devstack sudo[96127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['32d2707f-a90a-4983-8ccb-880152fe7d08'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:12 devstack cinder-volume[87256]: WARNING cinder.db.api [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-2105565705'] Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['712c4ba8-97a5-461d-bbd2-af11e40a2200', 'ea217e39-2763-44c1-98bb-ca799eb2f6c1', '585df663-ce03-460e-99a7-016cb8e63be0', 'd5251758-d1ff-4b01-b141-affffcc14cc9'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:12 devstack sudo[96136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:58:12 devstack sudo[96136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:12 devstack sudo[96127]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.484s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:58:12 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Deleted volume successfully. Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba01c66f-fbcf-4a8b-96f9-9fcdbaeadf3e tempest-VolumeRetypeWithoutMigrationTest-597122024 None] Lock "cinder-78ec42e5-5483-4edc-aee3-6616aac0a6ab-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:12 devstack sudo[96136]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.360s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:12 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:58:12 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-357543df-50b4-440f-ae10-1898a8edc71c tempest-GroupSnapshotsTest-1733960627 None] Delete group completed successfully. Sep 03 11:58:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a2df49f1-205f-401a-ac29-1c91c4e27eaf tempest-GroupSnapshotsTest-1733960627 None] Group tempest-GroupSnapshotsTest-Group-806124279: creating Sep 03 11:58:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a2df49f1-205f-401a-ac29-1c91c4e27eaf tempest-GroupSnapshotsTest-1733960627 None] Group tempest-GroupSnapshotsTest-Group-806124279: created successfully Sep 03 11:58:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a2df49f1-205f-401a-ac29-1c91c4e27eaf tempest-GroupSnapshotsTest-1733960627 None] Create group completed successfully. Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:16 devstack sudo[96207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:58:16 devstack sudo[96207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (8ec170b7-179b-49e7-8540-e0c5a41081b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49b46ca-8eaf-4c97-9b5c-59481920d3b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c49b46ca-8eaf-4c97-9b5c-59481920d3b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056632074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6361c2af-dbe3-403a-8d71-312a0d1ea189,host='devstack@QuobyteHD#QuobyteHD',id=7a984c01-f4f3-457e-adea-26b7623444a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:16Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244641ec-6018-4bc9-a622-68af763a4452),volume_type_id=244641ec-6018-4bc9-a622-68af763a4452)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a7088a-0a9b-4f18-a947-41adc7b82e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7a7088a-0a9b-4f18-a947-41adc7b82e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86524e44-88ed-404b-8971-4fe0942c0276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (86524e44-88ed-404b-8971-4fe0942c0276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a984c01-f4f3-457e-adea-26b7623444a4', 'volume_name': 'volume-7a984c01-f4f3-457e-adea-26b7623444a4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca3e170-5977-4300-a5f6-29199f513c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fca3e170-5977-4300-a5f6-29199f513c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebbd563-e7e9-4e77-8310-77e7986fd4e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:16 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Volume 7a984c01-f4f3-457e-adea-26b7623444a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a984c01-f4f3-457e-adea-26b7623444a4', 'volume_size': 1} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6361c2af-dbe3-403a-8d71-312a0d1ea189,created_at=2026-09-03T09:58:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2056632074',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6361c2af-dbe3-403a-8d71-312a0d1ea189,host='devstack@QuobyteHD#QuobyteHD',id=7a984c01-f4f3-457e-adea-26b7623444a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:16Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244641ec-6018-4bc9-a622-68af763a4452),volume_type_id=244641ec-6018-4bc9-a622-68af763a4452)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Creating volume 7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:58:16 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:16 devstack sudo[96215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 1073741824 Sep 03 11:58:16 devstack sudo[96215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:16 devstack sudo[96207]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.612s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:58:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:58:17 devstack sudo[96215]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 1073741824" returned: 0 in 0.936s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:17 devstack sudo[96228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 Sep 03 11:58:17 devstack sudo[96228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:18 devstack sudo[96228]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4" returned: 0 in 0.365s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] <== create_volume: return (1446ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.458s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bebbd563-e7e9-4e77-8310-77e7986fd4e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a984c01-f4f3-457e-adea-26b7623444a4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d57a4d5-fa2e-42d0-a117-111760bd1aa9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Volume volume-7a984c01-f4f3-457e-adea-26b7623444a4 (7a984c01-f4f3-457e-adea-26b7623444a4): created successfully Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d57a4d5-fa2e-42d0-a117-111760bd1aa9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (8ec170b7-179b-49e7-8540-e0c5a41081b0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b5be09aa-26d2-448d-b755-5a90b36264a4 tempest-GroupSnapshotsTest-1733960627 None] Created volume successfully. Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b8f66e0-53fb-4334-b7dc-a76f279540d0 tempest-VolumesActionsTest-93586440 None] Acquiring lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" by "attach_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b8f66e0-53fb-4334-b7dc-a76f279540d0 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" acquired by "attach_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7b8f66e0-53fb-4334-b7dc-a76f279540d0 tempest-VolumesActionsTest-93586440 None] Attaching volume 01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 to instance 584738f7-2d32-4f9a-9a04-10e0f405b219 at mountpoint /dev/vdb on host None. Sep 03 11:58:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7b8f66e0-53fb-4334-b7dc-a76f279540d0 tempest-VolumesActionsTest-93586440 None] Attach volume completed successfully. Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b8f66e0-53fb-4334-b7dc-a76f279540d0 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" released by "attach_volume" :: held 0.202s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Flow 'volume_create_manager' (a2a6b6a0-10a3-4599-801c-8899c44868ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd0b144-1eda-45ec-8dc4-598aeb935717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bbd0b144-1eda-45ec-8dc4-598aeb935717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-255034382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7464c5e7-9f5b-4593-9e24-28f23cb6b87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fe442c84a2454b8cc18a2349bd9982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:19Z,use_quota=True,user_id='5c05707966214793b05031cf8a957bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2979c52-5de1-4b4a-b938-85b43cc99ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a2979c52-5de1-4b4a-b938-85b43cc99ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb85d23-205c-4d23-941f-7f880f3eba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4eb85d23-205c-4d23-941f-7f880f3eba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7464c5e7-9f5b-4593-9e24-28f23cb6b87d', 'volume_name': 'volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4c6a83-9c9d-4394-9545-3c63bae2946f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6f4c6a83-9c9d-4394-9545-3c63bae2946f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338f128f-5652-439a-94ae-656301a9d8c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Volume 7464c5e7-9f5b-4593-9e24-28f23cb6b87d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d', 'volume_size': 1} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-255034382',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7464c5e7-9f5b-4593-9e24-28f23cb6b87d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5fe442c84a2454b8cc18a2349bd9982',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:19Z,use_quota=True,user_id='5c05707966214793b05031cf8a957bfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Creating volume 7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:58:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:58:19 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:19 devstack sudo[96231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d 1073741824 Sep 03 11:58:19 devstack sudo[96231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bdc4fa9d-cef6-4f59-a0e8-70845fa016f7 tempest-VolumesActionsTest-93586440 None] Acquiring lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-detach_volume" by "detach_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bdc4fa9d-cef6-4f59-a0e8-70845fa016f7 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-detach_volume" acquired by "detach_volume" :: waited 0.040s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bdc4fa9d-cef6-4f59-a0e8-70845fa016f7 tempest-VolumesActionsTest-93586440 None] Detaching volume 01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 from instance 584738f7-2d32-4f9a-9a04-10e0f405b219. Sep 03 11:58:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bdc4fa9d-cef6-4f59-a0e8-70845fa016f7 tempest-VolumesActionsTest-93586440 None] Detach volume completed successfully. Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bdc4fa9d-cef6-4f59-a0e8-70845fa016f7 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-detach_volume" released by "detach_volume" :: held 0.126s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:19 devstack sudo[96231]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d 1073741824" returned: 0 in 0.980s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:20 devstack sudo[96272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d Sep 03 11:58:20 devstack sudo[96272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:20 devstack sudo[96272]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" returned: 0 in 0.389s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] <== create_volume: return (1519ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.526s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (308b6258-d934-417a-9170-e336924b2bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7589245-b4c8-4b3a-90fe-a665ccbba4aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (338f128f-5652-439a-94ae-656301a9d8c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7cf91a-4635-44db-97f1-728a63cb37d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d7589245-b4c8-4b3a-90fe-a665ccbba4aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-618816050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6361c2af-dbe3-403a-8d71-312a0d1ea189,host='devstack@QuobyteHD#QuobyteHD',id=6dc75460-877a-489f-99e4-4804b577177c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:20Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244641ec-6018-4bc9-a622-68af763a4452),volume_type_id=244641ec-6018-4bc9-a622-68af763a4452)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb42079a-d5a4-45df-8d8d-4d3a31d9de57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb42079a-d5a4-45df-8d8d-4d3a31d9de57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8007c8c7-c758-4269-8bb0-e7b4ba670aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8007c8c7-c758-4269-8bb0-e7b4ba670aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dc75460-877a-489f-99e4-4804b577177c', 'volume_name': 'volume-6dc75460-877a-489f-99e4-4804b577177c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d944f9-7e37-410e-889e-6ab18a2944c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (58d944f9-7e37-410e-889e-6ab18a2944c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2d7fe-f173-4b73-9e64-6670cea5bb3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:20 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Volume 6dc75460-877a-489f-99e4-4804b577177c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dc75460-877a-489f-99e4-4804b577177c', 'volume_size': 1} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=6361c2af-dbe3-403a-8d71-312a0d1ea189,created_at=2026-09-03T09:58:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-618816050',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=6361c2af-dbe3-403a-8d71-312a0d1ea189,host='devstack@QuobyteHD#QuobyteHD',id=6dc75460-877a-489f-99e4-4804b577177c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:58:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:58:20Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(244641ec-6018-4bc9-a622-68af763a4452),volume_type_id=244641ec-6018-4bc9-a622-68af763a4452)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Creating volume 6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:58:20 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:20 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Volume volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d (7464c5e7-9f5b-4593-9e24-28f23cb6b87d): created successfully Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd7cf91a-4635-44db-97f1-728a63cb37d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:20 devstack sudo[96293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c 1073741824 Sep 03 11:58:20 devstack sudo[96293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Flow 'volume_create_manager' (a2a6b6a0-10a3-4599-801c-8899c44868ee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4f9be7a9-8f46-433f-bb94-ba0a690dbcd0 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Created volume successfully. Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:21 devstack sudo[96293]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c 1073741824" returned: 0 in 0.673s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:21 devstack sudo[96304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c Sep 03 11:58:21 devstack sudo[96304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:21 devstack sudo[96304]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c" returned: 0 in 0.337s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] <== create_volume: return (1056ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.060s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.415s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Creating offline snapshot 50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d of volume 7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fab2d7fe-f173-4b73-9e64-6670cea5bb3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dc75460-877a-489f-99e4-4804b577177c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70858274-cb27-4be9-a11e-57bf728c9de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a453e4da-7070-4c0f-bf9f-159565de117f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:21 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Volume volume-6dc75460-877a-489f-99e4-4804b577177c (6dc75460-877a-489f-99e4-4804b577177c): created successfully Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70858274-cb27-4be9-a11e-57bf728c9de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:58:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (308b6258-d934-417a-9170-e336924b2bcc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:58:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-063bf5f6-4def-4b64-a867-71ee5d4bb431 tempest-GroupSnapshotsTest-1733960627 None] Created volume successfully. Sep 03 11:58:21 devstack sudo[96308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d Sep 03 11:58:21 devstack sudo[96308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:22 devstack sudo[96308]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" returned: 0 in 0.494s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:22 devstack sudo[96314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d 1G Sep 03 11:58:22 devstack sudo[96314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:22 devstack sudo[96314]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d 1G" returned: 0 in 0.536s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:22 devstack sudo[96320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d Sep 03 11:58:22 devstack sudo[96320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-51d09a8d-0139-494b-9e5c-c971615bd6b4 tempest-GroupSnapshotsTest-1733960627 None] Update group completed successfully. Sep 03 11:58:23 devstack sudo[96320]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" returned: 0 in 0.370s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:23 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d is being set with open permissions: ugo+rw Sep 03 11:58:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:23 devstack sudo[96328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d Sep 03 11:58:23 devstack sudo[96328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:23 devstack sudo[96328]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:23 devstack sudo[96331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.info Sep 03 11:58:23 devstack sudo[96331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:23 devstack sudo[96331]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.info" returned: 0 in 0.330s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:23 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.info is being set with open permissions: ugo+rw Sep 03 11:58:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:23 devstack sudo[96334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.info Sep 03 11:58:23 devstack sudo[96334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:24 devstack sudo[96334]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.info" returned: 0 in 0.299s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.450s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-be10f275-f1b7-45c9-a382-cf44c6797c47 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Create snapshot completed successfully Sep 03 11:58:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-015e33b9-61f2-437e-aa2a-f4dc61cc98d0 tempest-GroupSnapshotsTest-1733960627 None] Update group completed successfully. Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "cinder-50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "cinder-quobyte-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-quobyte-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "cinder-quobyte-50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-quobyte-50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Deleting offline snapshot 50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d of volume 7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] snapshot_file for this snap is: volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ced819c-c5f7-4fa6-8eaf-19ba85b4f234]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:25 devstack sudo[96337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d Sep 03 11:58:25 devstack sudo[96337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=130,cinder:SELECT=126,cinder:INSERT=29,cinder:DELETE=7 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4db98670-5d68-4d8b-a108-5c6b32c5d90a tempest-GroupSnapshotsTest-1733960627 None] Update group completed successfully. Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[26746080-a3ca-4f1e-aefa-2a6604471338]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:25 devstack sudo[96337]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" returned: 0 in 0.485s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5e49a81-291a-4bc0-bd45-3ccf9d912554]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:25 devstack sudo[96342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:58:25 devstack sudo[96342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:25 devstack sudo[96343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d Sep 03 11:58:25 devstack sudo[96343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:26 devstack sudo[96342]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[08b28e76-70cd-4bae-845a-0b82e54e3b44]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:26 devstack sudo[96343]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" returned: 0 in 0.405s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:26 devstack sudo[96353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d Sep 03 11:58:26 devstack sudo[96353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:26 devstack sudo[96352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:58:26 devstack sudo[96352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:26 devstack sudo[96352]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.511s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.07f1d381-dab5-48e0-ae0f-f3a032e38ccc4c914_de.img {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:26 devstack sudo[96367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.07f1d381-dab5-48e0-ae0f-f3a032e38ccc4c914_de.img Sep 03 11:58:26 devstack sudo[96367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:26 devstack sudo[96353]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" returned: 0 in 0.626s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:26 devstack sudo[96369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d Sep 03 11:58:26 devstack sudo[96369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3e9a9923-b173-4d39-82c2-cb1f9f779ef3 tempest-GroupSnapshotsTest-1733960627 None] Update group completed successfully. Sep 03 11:58:27 devstack sudo[96369]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d.50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" returned: 0 in 0.428s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-quobyte-50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d" released by "_delete_snapshot" :: held 2.152s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-quobyte-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" released by "delete_snapshot" :: held 2.207s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:27 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Created reservations ['c9e14e1b-2ab0-4238-a31b-8fd7a2ce39c6', '8276935a-db28-4bd0-a260-f334752c9334', '2ea3ff51-9d44-40f0-b12c-ff134307deea', 'fe0d7485-e528-4afa-9600-708e5d9c3d67'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Delete snapshot completed successfully. Sep 03 11:58:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15022605-261b-41e5-ad46-ed687a07a1e2 tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-50cdc3f5-9bf2-48c6-ace7-4304f7f83c3d-delete_snapshot" released by "delete_snapshot" :: held 2.714s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "cinder-7464c5e7-9f5b-4593-9e24-28f23cb6b87d-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-7464c5e7-9f5b-4593-9e24-28f23cb6b87d-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "cinder-quobyte-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:58:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-quobyte-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" acquired by "delete_volume" :: waited 0.060s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:58:29 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[88594428-84ce-4f2f-97cd-a6761cdec589]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:29 devstack sudo[96383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d Sep 03 11:58:29 devstack sudo[96383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] GroupSnapshot 44367374-5268-48da-ad0b-19dda178c0ea: creating. Sep 03 11:58:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Group snapshot 44367374-5268-48da-ad0b-19dda178c0ea: creating. {{(pid=87256) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:58:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:30 devstack sudo[96383]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" returned: 0 in 0.929s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:30 devstack sudo[96389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d Sep 03 11:58:30 devstack sudo[96389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:30 devstack sudo[96389]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" returned: 0 in 0.672s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-quobyte-7464c5e7-9f5b-4593-9e24-28f23cb6b87d" released by "delete_volume" :: held 1.805s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:30 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Created reservations ['885bbeea-a854-4d2d-81ed-f7eb8fe51bf0', 'fa9475a6-3911-4f4b-a911-2275fde94060', 'fa193be6-fdbf-4260-ba52-2b036373cc72', '3b3ca995-6ffc-4510-8164-ad006a8f68f3'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:31 devstack sudo[96392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:58:31 devstack sudo[96392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:31 devstack sudo[96392]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.405s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:58:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Deleted volume successfully. Sep 03 11:58:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9348fbe6-c02e-493c-b6db-f2f60a5d9dfb tempest-VolumeSnapshotQuotasNegativeTestJSON-290825596 None] Lock "cinder-7464c5e7-9f5b-4593-9e24-28f23cb6b87d-delete_volume" released by "delete_volume" :: held 2.780s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:58:32 devstack sudo[96367]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.07f1d381-dab5-48e0-ae0f-f3a032e38ccc4c914_de.img" returned: 0 in 6.387s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[89625eba-b47b-4435-b1fd-b6f6ade9700d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:58:33 devstack sudo[96397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:58:33 devstack sudo[96397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:58:33 devstack sudo[96397]: pam_unix(sudo:session): session closed for user root Sep 03 11:58:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.626s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:58:33 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2, size 1024.00 MB, duration 6.39 sec, destination /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.07f1d381-dab5-48e0-ae0f-f3a032e38ccc4c914_de.img {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:58:33 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Converted 1024.00 MB image at 160.29 MB/s Sep 03 11:58:33 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] 07f1d381-dab5-48e0-ae0f-f3a032e38ccc was raw, no need to convert to raw {{(pid=87256) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 11:58:41 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:INSERT=11,cinder:UPDATE=50,cinder:SELECT=49,cinder:DELETE=5 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:58:43 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=18,cinder:UPDATE=15,cinder:INSERT=5 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:58:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 34.227s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:58:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Uploaded volume to glance image-id: 07f1d381-dab5-48e0-ae0f-f3a032e38ccc. {{(pid=87256) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:58:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 30.200s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:58:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Creating offline snapshot 37788064-c2c6-4d19-9947-489b449d539b of volume 6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:58:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a8289d93-b128-48a0-af09-e859c3c72a40 tempest-VolumesActionsTest-93586440 None] Copy volume to image completed successfully. Sep 03 11:58:59 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[94ade37b-340f-4dbe-aa20-7d21816b50df]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:58:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:00 devstack sudo[96502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c Sep 03 11:59:00 devstack sudo[96502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:00 devstack sudo[96502]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c" returned: 0 in 0.545s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:00 devstack sudo[96507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b 1G Sep 03 11:59:00 devstack sudo[96507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:01 devstack sudo[96507]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b 1G" returned: 0 in 0.691s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc75460-877a-489f-99e4-4804b577177c -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:01 devstack sudo[96513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc75460-877a-489f-99e4-4804b577177c -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b Sep 03 11:59:01 devstack sudo[96513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:01 devstack sudo[96513]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6dc75460-877a-489f-99e4-4804b577177c -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:01 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:01 devstack sudo[96518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b Sep 03 11:59:01 devstack sudo[96518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:02 devstack sudo[96518]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b" returned: 0 in 0.579s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:02 devstack sudo[96521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.info Sep 03 11:59:02 devstack sudo[96521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (d153039e-ff7a-440e-964a-eb637106d7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a9776a-bda4-4161-9066-a9e12499c2ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:02 devstack sudo[96521]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e1a9776a-bda4-4161-9066-a9e12499c2ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845638769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1797780a-c8c1-4a04-a684-b0cd2482a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:03Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de059d46-8206-4c67-9f65-29f7c9763de1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de059d46-8206-4c67-9f65-29f7c9763de1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbc05a1-c3ce-46af-9735-1cbedc15e1c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4fbc05a1-c3ce-46af-9735-1cbedc15e1c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1797780a-c8c1-4a04-a684-b0cd2482a459', 'volume_name': 'volume-1797780a-c8c1-4a04-a684-b0cd2482a459', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1202e4-6921-4739-8dd0-4b636459e17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7f1202e4-6921-4739-8dd0-4b636459e17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d820d9-84fc-4e16-ae68-6a1754636ca2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:02 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Volume 1797780a-c8c1-4a04-a684-b0cd2482a459: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1797780a-c8c1-4a04-a684-b0cd2482a459', 'volume_size': 1} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.info" returned: 0 in 0.420s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:02 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:02 devstack sudo[96524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.info Sep 03 11:59:02 devstack sudo[96524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:02 devstack sudo[96524]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.info" returned: 0 in 0.259s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.139s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Creating offline snapshot c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 of volume 7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[74432876-1081-41b0-897c-dbe99b589cb3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:03 devstack sudo[96527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 Sep 03 11:59:03 devstack sudo[96527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:03 devstack sudo[96527]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4" returned: 0 in 0.404s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:03 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 1G Sep 03 11:59:03 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:03 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 1G" returned: 0 in 0.530s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a984c01-f4f3-457e-adea-26b7623444a4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:04 devstack sudo[96539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a984c01-f4f3-457e-adea-26b7623444a4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 Sep 03 11:59:04 devstack sudo[96539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:04 devstack sudo[96539]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a984c01-f4f3-457e-adea-26b7623444a4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:04 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:04 devstack sudo[96544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 Sep 03 11:59:04 devstack sudo[96544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:04 devstack sudo[96544]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" returned: 0 in 0.260s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:04 devstack sudo[96547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.info Sep 03 11:59:04 devstack sudo[96547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:04 devstack sudo[96547]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.info" returned: 0 in 0.335s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:04 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:04 devstack sudo[96550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.info Sep 03 11:59:04 devstack sudo[96550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:05 devstack sudo[96550]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.info" returned: 0 in 0.379s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.315s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.600s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-845638769',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1797780a-c8c1-4a04-a684-b0cd2482a459,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:03Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Creating volume 1797780a-c8c1-4a04-a684-b0cd2482a459 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:05 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:05 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 1073741824 Sep 03 11:59:05 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-541288d2-affa-4c18-bbbf-53ab5cbff995 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 44367374-5268-48da-ad0b-19dda178c0ea: created successfully Sep 03 11:59:05 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 1073741824" returned: 0 in 0.617s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:06 devstack sudo[96558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 Sep 03 11:59:06 devstack sudo[96558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:06 devstack sudo[96558]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459" returned: 0 in 0.277s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 4.092s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3d820d9-84fc-4e16-ae68-6a1754636ca2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1797780a-c8c1-4a04-a684-b0cd2482a459', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16a1079-c2da-46a6-b3da-2721e85afd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae987065-2f02-49d6-b4ea-345903805058]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:06 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Volume volume-1797780a-c8c1-4a04-a684-b0cd2482a459 (1797780a-c8c1-4a04-a684-b0cd2482a459): created successfully Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b16a1079-c2da-46a6-b3da-2721e85afd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (d153039e-ff7a-440e-964a-eb637106d7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-172895b5-8b6b-4a40-a1df-2d840720d3fe tempest-VolumesActionsTest-1301100783 None] Created volume successfully. Sep 03 11:59:06 devstack sudo[96561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:59:06 devstack sudo[96561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 44367374-5268-48da-ad0b-19dda178c0ea: deleting Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 44367374-5268-48da-ad0b-19dda178c0ea: deleting {{(pid=87256) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-6dc75460-877a-489f-99e4-4804b577177c" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-6dc75460-877a-489f-99e4-4804b577177c" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-37788064-c2c6-4d19-9947-489b449d539b" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-37788064-c2c6-4d19-9947-489b449d539b" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Deleting offline snapshot 37788064-c2c6-4d19-9947-489b449d539b of volume 6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:59:06 devstack sudo[96561]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] snapshot_file for this snap is: volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-847c5c5e-799e-49c4-b350-372a9cdaf1ac tempest-VolumesActionsTest-1301100783 None] Acquiring lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459" by "attach_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.669s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3290fd6f-f0b4-43ae-9d21-a6c823d6b9d6]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-847c5c5e-799e-49c4-b350-372a9cdaf1ac tempest-VolumesActionsTest-1301100783 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459" acquired by "attach_volume" :: waited 0.051s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[603fac88-82b9-4746-a977-7bbc90cd7ce6]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-847c5c5e-799e-49c4-b350-372a9cdaf1ac tempest-VolumesActionsTest-1301100783 None] Attaching volume 1797780a-c8c1-4a04-a684-b0cd2482a459 to instance 3ecbff9d-6c9d-4915-b683-d29f1b2d815d at mountpoint /dev/vdb on host None. Sep 03 11:59:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-847c5c5e-799e-49c4-b350-372a9cdaf1ac tempest-VolumesActionsTest-1301100783 None] Attach volume completed successfully. Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-847c5c5e-799e-49c4-b350-372a9cdaf1ac tempest-VolumesActionsTest-1301100783 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459" released by "attach_volume" :: held 0.162s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:07 devstack sudo[96567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b Sep 03 11:59:07 devstack sudo[96567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:07 devstack sudo[96568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:59:07 devstack sudo[96568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:07 devstack sudo[96567]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b" returned: 0 in 0.762s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6dc75460-877a-489f-99e4-4804b577177c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[41308ce0-5206-4202-bf5d-e27bb54220d0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:07 devstack sudo[96568]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.933s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:08 devstack sudo[96578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c Sep 03 11:59:08 devstack sudo[96578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:08 devstack sudo[96579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img Sep 03 11:59:08 devstack sudo[96579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-dbf41397-d4d7-4410-9bbf-444e4b15ece5 tempest-VolumesActionsTest-481777542 None] Terminate volume connection completed successfully. Sep 03 11:59:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dbf41397-d4d7-4410-9bbf-444e4b15ece5 tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-detach_volume" by "detach_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dbf41397-d4d7-4410-9bbf-444e4b15ece5 tempest-VolumesActionsTest-481777542 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-detach_volume" acquired by "detach_volume" :: waited 0.096s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:08 devstack sudo[96578]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c" returned: 0 in 1.165s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-dbf41397-d4d7-4410-9bbf-444e4b15ece5 tempest-VolumesActionsTest-481777542 None] Detaching volume 1797780a-c8c1-4a04-a684-b0cd2482a459 from instance 3ecbff9d-6c9d-4915-b683-d29f1b2d815d. Sep 03 11:59:09 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b Sep 03 11:59:09 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-dbf41397-d4d7-4410-9bbf-444e4b15ece5 tempest-VolumesActionsTest-481777542 None] Detach volume completed successfully. Sep 03 11:59:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dbf41397-d4d7-4410-9bbf-444e4b15ece5 tempest-VolumesActionsTest-481777542 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-detach_volume" released by "detach_volume" :: held 0.405s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446986d1-b566-45b8-addc-72f80814d92a tempest-VolumesActionsTest-1301100783 None] Acquiring lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-detach_volume" by "detach_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446986d1-b566-45b8-addc-72f80814d92a tempest-VolumesActionsTest-1301100783 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-detach_volume" acquired by "detach_volume" :: waited 0.080s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:10 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-446986d1-b566-45b8-addc-72f80814d92a tempest-VolumesActionsTest-1301100783 None] Volume detach called, but volume not attached. Sep 03 11:59:10 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b" returned: 0 in 1.200s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446986d1-b566-45b8-addc-72f80814d92a tempest-VolumesActionsTest-1301100783 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-detach_volume" released by "detach_volume" :: held 0.120s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:10 devstack sudo[96601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b Sep 03 11:59:10 devstack sudo[96601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Acquiring lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:11 devstack sudo[96601]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c.37788064-c2c6-4d19-9947-489b449d539b" returned: 0 in 0.926s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-delete_volume" acquired by "delete_volume" :: waited 0.157s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-37788064-c2c6-4d19-9947-489b449d539b" released by "_delete_snapshot" :: held 4.314s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-6dc75460-877a-489f-99e4-4804b577177c" released by "delete_snapshot" :: held 4.406s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Acquiring lock "cinder-quobyte-1797780a-c8c1-4a04-a684-b0cd2482a459" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-7a984c01-f4f3-457e-adea-26b7623444a4" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Lock "cinder-quobyte-1797780a-c8c1-4a04-a684-b0cd2482a459" acquired by "delete_volume" :: waited 0.057s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-7a984c01-f4f3-457e-adea-26b7623444a4" acquired by "delete_snapshot" :: waited 0.092s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9c936cf8-29fc-48e1-a9e1-4b0867a10065]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" acquired by "_delete_snapshot" :: waited 0.115s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Deleting offline snapshot c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 of volume 7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] snapshot_file for this snap is: volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[daf34d33-7710-442b-9908-3cc67dea6fae]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:11 devstack sudo[96604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 Sep 03 11:59:11 devstack sudo[96604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:12 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 Sep 03 11:59:12 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:12 devstack sudo[96604]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459" returned: 0 in 1.136s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:12 devstack sudo[96611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459 Sep 03 11:59:12 devstack sudo[96611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:13 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" returned: 0 in 1.409s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a984c01-f4f3-457e-adea-26b7623444a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:13 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[4752db40-0048-46f0-a653-f4014ad120fe]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:13 devstack sudo[96634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 Sep 03 11:59:13 devstack sudo[96634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:13 devstack sudo[96611]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1797780a-c8c1-4a04-a684-b0cd2482a459" returned: 0 in 1.177s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Lock "cinder-quobyte-1797780a-c8c1-4a04-a684-b0cd2482a459" released by "delete_volume" :: held 2.501s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Created reservations ['ac077896-173a-48aa-8528-2d4ef835f95c', '854eb81e-4254-4456-aa3a-5d476dd0cca0', 'd99a79f7-1fcf-48fb-bac6-6edd62b876b8', '34d43659-6136-45d5-9080-562970f11930'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:14 devstack sudo[96640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:14 devstack sudo[96640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:14 devstack sudo[96634]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4" returned: 0 in 1.301s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:14 devstack sudo[96642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 Sep 03 11:59:14 devstack sudo[96642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:15 devstack sudo[96640]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.972s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Deleted volume successfully. Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bb35b165-6d70-4dcb-a367-21719105cfdc tempest-VolumesActionsTest-1301100783 None] Lock "cinder-1797780a-c8c1-4a04-a684-b0cd2482a459-delete_volume" released by "delete_volume" :: held 4.229s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:15 devstack sudo[96579]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img" returned: 0 in 7.480s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f4b741f-d6e0-4c33-9530-0ee6218f5827]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:15 devstack sudo[96642]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:15 devstack sudo[96648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:59:15 devstack sudo[96648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" returned: 0 in 1.151s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:15 devstack sudo[96653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20 Sep 03 11:59:15 devstack sudo[96653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:16 devstack sudo[96653]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4.c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" returned: 0 in 0.464s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-c83a95ef-6e94-45ed-8f75-f9c98ad1ff20" released by "_delete_snapshot" :: held 4.679s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-7a984c01-f4f3-457e-adea-26b7623444a4" released by "delete_snapshot" :: held 4.826s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:16 devstack sudo[96675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:16 devstack sudo[96675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:16 devstack sudo[96648]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.940s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2, size 1024.00 MB, duration 7.49 sec, destination /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:59:16 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Converted 1024.00 MB image at 136.81 MB/s Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] 1d63cd4f-9f18-413e-ba49-000a7e42cf19 was raw, converting to qcow2 {{(pid=87256) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1179}} Sep 03 11:59:16 devstack cinder-volume[87256]: WARNING cinder.quota [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-184966985 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-184966985, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:59:16 devstack cinder-volume[87256]: WARNING cinder.quota [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-184966985 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-184966985, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[42971543-662c-467f-83bc-5bfdde3066c0]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['07cba131-63e7-454e-b746-90d054d023c9', 'c0b2baaa-19c7-4b3e-aebc-b97574cac0d1', 'a1a3c0f6-96c6-46b1-bd4e-1a82361a3206', '6a284837-05fa-4603-a565-5345e32ba523'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:16 devstack sudo[96679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img Sep 03 11:59:16 devstack sudo[96679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:16 devstack sudo[96675]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 11:59:16 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['fc33d646-fc57-4df5-9d8c-ccb8f611a5cc', '81e03da6-a802-4629-a68b-de1177d58fb7', 'c8e753b7-378b-4b4c-bc4c-431e595d8e4d', 'af33db70-6bc7-4c1c-b3c7-424cd0106d6e'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b7052c37-fbdc-49ff-9c7b-3e93fcf35d13 tempest-GroupSnapshotsTest-1733960627 None] group_snapshot 44367374-5268-48da-ad0b-19dda178c0ea: deleted successfully Sep 03 11:59:17 devstack sudo[96679]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img" returned: 0 in 0.643s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:17 devstack sudo[96685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img Sep 03 11:59:17 devstack sudo[96685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (53825963-e420-4da4-a248-96fe732bd471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8535cd0a-13c4-4b28-9b2d-8594c7fd6328) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8535cd0a-13c4-4b28-9b2d-8594c7fd6328) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-879770533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1c9890-c4ee-47a0-b6d6-7579019712fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:17Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb40e0f8-ea72-4b01-b414-2984f56a892d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eb40e0f8-ea72-4b01-b414-2984f56a892d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34a9947-d7dd-4f0f-9b18-252c251f76d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d34a9947-d7dd-4f0f-9b18-252c251f76d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1c9890-c4ee-47a0-b6d6-7579019712fe', 'volume_name': 'volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1269b95f-4ed5-441f-8d44-72aa5f2a6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1269b95f-4ed5-441f-8d44-72aa5f2a6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c536c73-a912-428e-abf8-de6e6d4e46d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:17 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Volume fa1c9890-c4ee-47a0-b6d6-7579019712fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe', 'volume_size': 1} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:17 devstack sudo[96685]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img" returned: 1 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img /opt/stack/data/cinder/conversion/vol_upload_m1wgr93f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:17 devstack sudo[96690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img /opt/stack/data/cinder/conversion/vol_upload_m1wgr93f Sep 03 11:59:17 devstack sudo[96690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:17 devstack sudo[96690]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img /opt/stack/data/cinder/conversion/vol_upload_m1wgr93f" returned: 0 in 0.303s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Image conversion details: src /opt/stack/data/cinder/conversion/01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2.temp_image.1d63cd4f-9f18-413e-ba49-000a7e42cf19mtrp8z9s.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_m1wgr93f {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:59:17 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Converted 1024.00 MB image at 1024.00 MB/s Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcee3a42-8aa8-4b2b-98db-a9046cec0a30]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m1wgr93f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-6dc75460-877a-489f-99e4-4804b577177c" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-6dc75460-877a-489f-99e4-4804b577177c" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:17 devstack sudo[96696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m1wgr93f Sep 03 11:59:17 devstack sudo[96696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1e01226-d351-47a9-930e-48021c67d7fc]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:18 devstack sudo[96698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c Sep 03 11:59:18 devstack sudo[96698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:18 devstack sudo[96696]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_m1wgr93f" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:18 devstack sudo[96698]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c" returned: 0 in 0.358s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:18 devstack sudo[96706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c Sep 03 11:59:18 devstack sudo[96706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:18 devstack sudo[96706]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dc75460-877a-489f-99e4-4804b577177c" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-6dc75460-877a-489f-99e4-4804b577177c" released by "delete_volume" :: held 0.662s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-7a984c01-f4f3-457e-adea-26b7623444a4" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-7a984c01-f4f3-457e-adea-26b7623444a4" acquired by "delete_volume" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[414fbd0b-774b-4c95-a228-4163fc0f03db]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:18 devstack sudo[96709]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 Sep 03 11:59:18 devstack sudo[96709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:19 devstack sudo[96709]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4" returned: 0 in 0.392s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:19 devstack sudo[96714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4 Sep 03 11:59:19 devstack sudo[96714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:19 devstack sudo[96714]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a984c01-f4f3-457e-adea-26b7623444a4" returned: 0 in 0.321s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (ee0e365d-97df-4410-8f52-25a6121f0ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed83b52-79fd-43ba-9433-5f2e3f233e37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-7a984c01-f4f3-457e-adea-26b7623444a4" released by "delete_volume" :: held 0.807s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ed83b52-79fd-43ba-9433-5f2e3f233e37) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067936360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd800e2-8909-4686-9ad1-a19f80daa713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:19Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500d764c-eb57-44a0-9447-43b2af347b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (500d764c-eb57-44a0-9447-43b2af347b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e829e3-bead-4fdc-86f2-a0b518922e13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73e829e3-bead-4fdc-86f2-a0b518922e13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fd800e2-8909-4686-9ad1-a19f80daa713', 'volume_name': 'volume-9fd800e2-8909-4686-9ad1-a19f80daa713', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7a2372-ba7b-44d5-ab2c-d486aa319ada) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1a7a2372-ba7b-44d5-ab2c-d486aa319ada) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fa8a7e-27f1-480b-9556-53b565e19da0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:19 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Volume 9fd800e2-8909-4686-9ad1-a19f80daa713: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fd800e2-8909-4686-9ad1-a19f80daa713', 'volume_size': 1} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['9424a95c-1275-4cbd-ab6c-6c64446ca744'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:19 devstack cinder-volume[87256]: WARNING cinder.quota [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-184966985 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-184966985, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['91966521-12e0-4df8-b725-4ac079adf3de', 'f2d3815f-6cd7-449d-ad7e-47bedf055683', '376940a9-f8b8-4fda-ae17-b4f38dff349e', '6465cc5e-30dc-4775-8561-18cfbb858d9c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 13.365s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Uploaded volume to glance image-id: 1d63cd4f-9f18-413e-ba49-000a7e42cf19. {{(pid=87256) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.229s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-879770533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1c9890-c4ee-47a0-b6d6-7579019712fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:17Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Creating volume fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:19 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:19 devstack sudo[96717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe 1073741824 Sep 03 11:59:19 devstack sudo[96717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-38af88f3-e577-4add-9574-03c12d7bf542 tempest-VolumesActionsTest-93586440 None] Copy volume to image completed successfully. Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['4b1fa081-a952-440d-b455-62bb9b769304', '033e49ae-883b-4e18-b1c2-5ad837218edb', '28efc103-b58b-428e-ade5-f84c97e13070', '4ef8b76b-f199-4c42-bf8c-abbdabf9ea08'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:19 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:19 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:20 devstack sudo[96717]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe 1073741824" returned: 0 in 0.437s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:20 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.282s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b2a1d145-e4b6-43d4-b2d2-6d50189aada1 tempest-GroupSnapshotsTest-1733960627 None] Delete group completed successfully. Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:20 devstack sudo[96725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe Sep 03 11:59:20 devstack sudo[96725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:20 devstack sudo[96725]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe" returned: 0 in 0.268s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] <== create_volume: return (756ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.931s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1067936360',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fd800e2-8909-4686-9ad1-a19f80daa713,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:19Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Creating volume 9fd800e2-8909-4686-9ad1-a19f80daa713 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:20 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c536c73-a912-428e-abf8-de6e6d4e46d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:20 devstack sudo[96729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 1073741824 Sep 03 11:59:20 devstack sudo[96729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6645bd52-a19d-4ec7-a785-1ac65a1fe81e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:20 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Volume volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe (fa1c9890-c4ee-47a0-b6d6-7579019712fe): created successfully Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6645bd52-a19d-4ec7-a785-1ac65a1fe81e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (53825963-e420-4da4-a248-96fe732bd471) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-94795cd4-1d7d-4d0c-9386-bee5b587f1ea tempest-VolumesSnapshotTestJSON-1351489798 None] Created volume successfully. Sep 03 11:59:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-22411515-9412-4c91-806d-85d0fb0e81dd tempest-GroupSnapshotsTest-1733960627 None] Group tempest-GroupSnapshotsTest-Group-1612463124: creating Sep 03 11:59:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-22411515-9412-4c91-806d-85d0fb0e81dd tempest-GroupSnapshotsTest-1733960627 None] Group tempest-GroupSnapshotsTest-Group-1612463124: created successfully Sep 03 11:59:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-22411515-9412-4c91-806d-85d0fb0e81dd tempest-GroupSnapshotsTest-1733960627 None] Create group completed successfully. Sep 03 11:59:20 devstack sudo[96729]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 1073741824" returned: 0 in 0.559s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:21 devstack sudo[96769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 Sep 03 11:59:21 devstack sudo[96769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:21 devstack sudo[96769]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Acquiring lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713" returned: 0 in 0.293s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] <== create_volume: return (899ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (74fa8a7e-27f1-480b-9556-53b565e19da0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fd800e2-8909-4686-9ad1-a19f80daa713', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f29392-6093-4634-8cfc-5826cc48ebd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:21 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Volume volume-9fd800e2-8909-4686-9ad1-a19f80daa713 (9fd800e2-8909-4686-9ad1-a19f80daa713): created successfully Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (13f29392-6093-4634-8cfc-5826cc48ebd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (ee0e365d-97df-4410-8f52-25a6121f0ea8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5fb9ed1b-124f-489a-b740-e1933d562a2e tempest-VolumesActionsTest-1301100783 None] Created volume successfully. Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Acquiring lock "cinder-quobyte-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Lock "cinder-quobyte-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb8cf008-42b5-4d56-93e3-d2cab54510cb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:21 devstack sudo[96774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:59:21 devstack sudo[96774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:21 devstack sudo[96774]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.395s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Creating offline snapshot 74ee8ab1-1845-4a63-ba52-c9a5804a3340 of volume fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:59:21 devstack sudo[96779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2 Sep 03 11:59:21 devstack sudo[96779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb47297-1371-4466-b5fc-1d8cde871fcc]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:22 devstack sudo[96781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe Sep 03 11:59:22 devstack sudo[96781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:22 devstack sudo[96779]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Lock "cinder-quobyte-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2" released by "delete_volume" :: held 0.724s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Created reservations ['affee229-ed2c-4532-8a8e-82bb924d4d3d', '9278b706-9089-4f8d-a5b2-571dfd890d21', 'c0c1bf79-b93b-4dcb-8eb4-0e1f7b16463c', '73ba9ef6-adb1-42c0-af19-6ccb96a91837'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:22 devstack sudo[96781]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:22 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe" returned: 0 in 0.438s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:22 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:22 devstack sudo[96789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 1G Sep 03 11:59:22 devstack sudo[96789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (a01dbb02-e92e-4373-af04-e915e844e05a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c736b0f9-5b2f-4c30-9344-ace6710f211f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c736b0f9-5b2f-4c30-9344-ace6710f211f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-770686232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a1e8114-5621-41a1-9859-7148958ff671,host='devstack@QuobyteHD#QuobyteHD',id=a17eaeb3-5d68-420a-8ed8-d168a987b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:22Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffdf8e9b-1584-49b3-9231-a4d41753c28e),volume_type_id=ffdf8e9b-1584-49b3-9231-a4d41753c28e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd36d8b3-a8e3-41d9-8cc7-361dfa1bb893) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd36d8b3-a8e3-41d9-8cc7-361dfa1bb893) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0397f-5075-4b8b-82c8-90a1375dd351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1bb0397f-5075-4b8b-82c8-90a1375dd351) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17eaeb3-5d68-420a-8ed8-d168a987b071', 'volume_name': 'volume-a17eaeb3-5d68-420a-8ed8-d168a987b071', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24fe14-750d-48f0-aaf9-ae3b4e138f22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d24fe14-750d-48f0-aaf9-ae3b4e138f22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:22 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeb8f62-22eb-42c9-b323-3de1a8a6adab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:22 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Volume a17eaeb3-5d68-420a-8ed8-d168a987b071: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17eaeb3-5d68-420a-8ed8-d168a987b071', 'volume_size': 1} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.399s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Deleted volume successfully. Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20644b24-df0a-4b13-b079-29d882c587d8 tempest-VolumesActionsTest-93586440 None] Lock "cinder-01e2d3af-fb9c-4e66-84d1-e4d09b05f9a2-delete_volume" released by "delete_volume" :: held 1.407s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-9fd800e2-8909-4686-9ad1-a19f80daa713-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Lock "cinder-9fd800e2-8909-4686-9ad1-a19f80daa713-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-quobyte-9fd800e2-8909-4686-9ad1-a19f80daa713" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-9fd800e2-8909-4686-9ad1-a19f80daa713" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:22 devstack sudo[96789]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 1G" returned: 0 in 0.601s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[03a5975e-cd46-4d09-a9ce-96e5830d08d6]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:22 devstack sudo[96798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 Sep 03 11:59:22 devstack sudo[96798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:23 devstack sudo[96799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 Sep 03 11:59:23 devstack sudo[96799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:23 devstack sudo[96798]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340" returned: 0 in 0.333s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:23 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 is being set with open permissions: ugo+rw Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:23 devstack sudo[96808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 Sep 03 11:59:23 devstack sudo[96808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:23 devstack sudo[96799]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713" returned: 0 in 0.408s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:23 devstack sudo[96812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713 Sep 03 11:59:23 devstack sudo[96812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:23 devstack sudo[96808]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340" returned: 0 in 0.276s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:23 devstack sudo[96816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.info Sep 03 11:59:23 devstack sudo[96816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:23 devstack sudo[96812]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9fd800e2-8909-4686-9ad1-a19f80daa713" returned: 0 in 0.268s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-9fd800e2-8909-4686-9ad1-a19f80daa713" released by "delete_volume" :: held 0.734s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Created reservations ['9aed19b6-ac59-424f-a9c9-3701b45772a8', 'c94af185-5cd6-40e7-be0c-eea7c716d357', '3e028ae7-43e5-44d7-993c-d82f73dfd486', '3d2a22b4-2d63-470d-8e84-6de5ccb8b60e'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:23 devstack sudo[96818]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:23 devstack sudo[96818]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:23 devstack sudo[96816]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.info" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:23 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.info is being set with open permissions: ugo+rw Sep 03 11:59:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:23 devstack sudo[96821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.info Sep 03 11:59:23 devstack sudo[96821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:24 devstack sudo[96818]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.296s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Deleted volume successfully. Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b3cadd76-675f-4df6-a092-166d8d4b13c6 tempest-VolumesActionsTest-481777542 None] Lock "cinder-9fd800e2-8909-4686-9ad1-a19f80daa713-delete_volume" released by "delete_volume" :: held 1.318s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:24 devstack sudo[96821]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.info" returned: 0 in 0.355s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.570s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=7a1e8114-5621-41a1-9859-7148958ff671,created_at=2026-09-03T09:59:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-770686232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=7a1e8114-5621-41a1-9859-7148958ff671,host='devstack@QuobyteHD#QuobyteHD',id=a17eaeb3-5d68-420a-8ed8-d168a987b071,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='26ef20dcf0634dfb8980055d702e57df',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:22Z,use_quota=True,user_id='d66f03a0d3144cd092e39cd6a9b2827e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ffdf8e9b-1584-49b3-9231-a4d41753c28e),volume_type_id=ffdf8e9b-1584-49b3-9231-a4d41753c28e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Creating volume a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:24 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:24 devstack sudo[96826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 1073741824 Sep 03 11:59:24 devstack sudo[96826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3a960530-4a52-4cba-b23a-35514efd491f tempest-VolumesSnapshotTestJSON-1351489798 None] Create snapshot completed successfully Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (fd7283c0-5cb9-439e-96bf-988d5e1a5ddf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038addbc-62a7-4797-8c1e-e8e8a198c233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (038addbc-62a7-4797-8c1e-e8e8a198c233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1573345780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a438d9-c2d1-44fc-838d-45d57aaf33c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:25Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b2d9c7-2dd8-4e66-9f3c-1b95ce05bdf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82b2d9c7-2dd8-4e66-9f3c-1b95ce05bdf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b07fc94-ce9b-46f9-ab32-b778402ed374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6b07fc94-ce9b-46f9-ab32-b778402ed374) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f6a438d9-c2d1-44fc-838d-45d57aaf33c9', 'volume_name': 'volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e33c02-ddf7-4e7c-a3dc-8e47b8120b44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (76e33c02-ddf7-4e7c-a3dc-8e47b8120b44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d2422e-a8f8-421f-81d4-289360045855) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Volume f6a438d9-c2d1-44fc-838d-45d57aaf33c9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9', 'volume_size': 1} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:24 devstack sudo[96826]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 1073741824" returned: 0 in 0.506s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:24 devstack sudo[96832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 Sep 03 11:59:24 devstack sudo[96832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:25 devstack sudo[96832]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.812s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.311s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1573345780',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f6a438d9-c2d1-44fc-838d-45d57aaf33c9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:25Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Creating volume f6a438d9-c2d1-44fc-838d-45d57aaf33c9 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:25 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (adeb8f62-22eb-42c9-b323-3de1a8a6adab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17eaeb3-5d68-420a-8ed8-d168a987b071', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57aca08-b6b5-41a9-9e99-dd48feb47e1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-74ee8ab1-1845-4a63-ba52-c9a5804a3340-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:25 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 1073741824 Sep 03 11:59:25 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Volume volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 (a17eaeb3-5d68-420a-8ed8-d168a987b071): created successfully Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d57aca08-b6b5-41a9-9e99-dd48feb47e1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Flow 'volume_create_manager' (a01dbb02-e92e-4373-af04-e915e844e05a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-74ee8ab1-1845-4a63-ba52-c9a5804a3340-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6eeac584-a12c-467c-8dd4-7f3b0fd6de50 tempest-GroupSnapshotsTest-1733960627 None] Created volume successfully. Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-fa1c9890-c4ee-47a0-b6d6-7579019712fe" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-fa1c9890-c4ee-47a0-b6d6-7579019712fe" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-74ee8ab1-1845-4a63-ba52-c9a5804a3340" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-74ee8ab1-1845-4a63-ba52-c9a5804a3340" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Deleting offline snapshot 74ee8ab1-1845-4a63-ba52-c9a5804a3340 of volume fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] snapshot_file for this snap is: volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8fa98747-5cfe-461b-9235-11d79986ea9b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:25 devstack sudo[96837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 Sep 03 11:59:25 devstack sudo[96837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:25 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 1073741824" returned: 0 in 0.484s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:25 devstack sudo[96845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 Sep 03 11:59:25 devstack sudo[96845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:25 devstack sudo[96837]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340" returned: 0 in 0.378s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[021b184f-61f6-412c-b361-b224a071be81]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:25 devstack sudo[96847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe Sep 03 11:59:25 devstack sudo[96847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:25 devstack sudo[96845]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9" returned: 0 in 0.291s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] <== create_volume: return (821ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.825s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2d2422e-a8f8-421f-81d4-289360045855) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564a0b04-5a39-426d-99d8-7da66ac10fce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Volume volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 (f6a438d9-c2d1-44fc-838d-45d57aaf33c9): created successfully Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (564a0b04-5a39-426d-99d8-7da66ac10fce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (fd7283c0-5cb9-439e-96bf-988d5e1a5ddf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-53c48fc8-3302-40d9-b52d-ddf67c72ff86 tempest-VolumesActionsTest-1301100783 None] Created volume successfully. Sep 03 11:59:26 devstack sudo[96847]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe" returned: 0 in 0.453s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:26 devstack sudo[96854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 Sep 03 11:59:26 devstack sudo[96854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] GroupSnapshot d4f7a1e9-c31f-4cba-983d-9bee87df6f64: creating. Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Group snapshot d4f7a1e9-c31f-4cba-983d-9bee87df6f64: creating. {{(pid=87256) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Creating offline snapshot db50b8bf-7475-4ef3-9c12-2d6f4e9152bf of volume a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebd426dd-6f4b-4b65-92be-ad1bb24ca0da]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:26 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 Sep 03 11:59:26 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:26 devstack sudo[96854]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340" returned: 0 in 0.338s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:26 devstack sudo[96861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340 Sep 03 11:59:26 devstack sudo[96861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:26 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071" returned: 0 in 0.419s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:26 devstack sudo[96861]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe.74ee8ab1-1845-4a63-ba52-c9a5804a3340" returned: 0 in 0.306s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:26 devstack sudo[96867]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf 1G Sep 03 11:59:26 devstack sudo[96867]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-74ee8ab1-1845-4a63-ba52-c9a5804a3340" released by "_delete_snapshot" :: held 1.619s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-fa1c9890-c4ee-47a0-b6d6-7579019712fe" released by "delete_snapshot" :: held 1.648s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-f6a438d9-c2d1-44fc-838d-45d57aaf33c9-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Lock "cinder-f6a438d9-c2d1-44fc-838d-45d57aaf33c9-delete_volume" acquired by "delete_volume" :: waited 0.064s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-quobyte-f6a438d9-c2d1-44fc-838d-45d57aaf33c9" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['dc814ebf-1116-4309-b27a-8fba54b84fd1', '34864932-8d0a-4d86-89bf-6ed75fcfd102', '3a516e0c-4279-4f56-9f9d-ff5f51589573', '8d6ba44d-be71-44c9-bdff-cb000a6feb55'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-f6a438d9-c2d1-44fc-838d-45d57aaf33c9" acquired by "delete_volume" :: waited 0.039s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce9f9910-fe57-45a2-965e-befc216a20cb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Delete snapshot completed successfully. Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-179742bd-3cf2-4cb9-a1bf-afc35ae99ed3 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-74ee8ab1-1845-4a63-ba52-c9a5804a3340-delete_snapshot" released by "delete_snapshot" :: held 2.022s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:27 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 Sep 03 11:59:27 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:27 devstack sudo[96867]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf 1G" returned: 0 in 0.716s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:27 devstack sudo[96877]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf Sep 03 11:59:27 devstack sudo[96877]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:27 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9" returned: 0 in 0.496s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:27 devstack sudo[96881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9 Sep 03 11:59:27 devstack sudo[96881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:27 devstack sudo[96877]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" returned: 0 in 0.403s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:27 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:27 devstack sudo[96887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf Sep 03 11:59:27 devstack sudo[96887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:27 devstack sudo[96881]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f6a438d9-c2d1-44fc-838d-45d57aaf33c9" returned: 0 in 0.358s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-f6a438d9-c2d1-44fc-838d-45d57aaf33c9" released by "delete_volume" :: held 0.931s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Created reservations ['33033244-5c70-4311-a18f-682448c11437', '96e41993-5aa9-4a17-8812-7403d165ea3b', '0bfb0418-e0f0-4fde-a8fb-7836b82822f0', '39654ce0-9999-4655-852f-c365efeb29b2'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (eb4423e1-f7f6-4fa7-8ba5-949d5a201067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e035c7-8685-4e54-96a3-f4c809da6ed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e0e035c7-8685-4e54-96a3-f4c809da6ed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-321459466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c94c5-ee76-49ea-9297-819a7924dd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:28Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46d8d07-1380-4373-b019-5d3fef3db9db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46d8d07-1380-4373-b019-5d3fef3db9db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea575b6a-1343-4734-9ae1-28905e6dcfce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ea575b6a-1343-4734-9ae1-28905e6dcfce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '662c94c5-ee76-49ea-9297-819a7924dd00', 'volume_name': 'volume-662c94c5-ee76-49ea-9297-819a7924dd00', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e49fd08-ab19-48b6-9ca9-a6986b61e3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e49fd08-ab19-48b6-9ca9-a6986b61e3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0853946-b4a9-4821-96e2-f377210f1d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:28 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Volume 662c94c5-ee76-49ea-9297-819a7924dd00: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-662c94c5-ee76-49ea-9297-819a7924dd00', 'volume_size': 1} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:28 devstack sudo[96887]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" returned: 0 in 0.344s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:28 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:28 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:28 devstack sudo[96893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.info Sep 03 11:59:28 devstack sudo[96893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:28 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.303s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:28 devstack sudo[96893]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Deleted volume successfully. Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.info" returned: 0 in 0.296s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:28 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:28 devstack sudo[96897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.info Sep 03 11:59:28 devstack sudo[96897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e98cf1f-590d-4248-a67c-0dc1555bfde5 tempest-VolumesActionsTest-481777542 None] Lock "cinder-f6a438d9-c2d1-44fc-838d-45d57aaf33c9-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:28 devstack sudo[96897]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.info" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.557s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.688s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-321459466',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=662c94c5-ee76-49ea-9297-819a7924dd00,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:28Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Creating volume 662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:28 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:28 devstack sudo[96900]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 1073741824 Sep 03 11:59:28 devstack sudo[96900]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-97715e57-2a86-4f71-93bf-50e11b70b6ca tempest-GroupSnapshotsTest-1733960627 None] group_snapshot d4f7a1e9-c31f-4cba-983d-9bee87df6f64: created successfully Sep 03 11:59:29 devstack sudo[96900]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 1073741824" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:29 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 Sep 03 11:59:29 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] group_snapshot d4f7a1e9-c31f-4cba-983d-9bee87df6f64: deleting Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] group_snapshot d4f7a1e9-c31f-4cba-983d-9bee87df6f64: deleting {{(pid=87256) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-a17eaeb3-5d68-420a-8ed8-d168a987b071" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-a17eaeb3-5d68-420a-8ed8-d168a987b071" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:29 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Deleting offline snapshot db50b8bf-7475-4ef3-9c12-2d6f4e9152bf of volume a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] snapshot_file for this snap is: volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00" returned: 0 in 0.432s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad14390a-fba4-4ec3-aa10-cc825ea88c58]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0853946-b4a9-4821-96e2-f377210f1d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-662c94c5-ee76-49ea-9297-819a7924dd00', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6c7348-3083-499d-86ee-f3f3a87b2233) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Volume volume-662c94c5-ee76-49ea-9297-819a7924dd00 (662c94c5-ee76-49ea-9297-819a7924dd00): created successfully Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db6c7348-3083-499d-86ee-f3f3a87b2233) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (eb4423e1-f7f6-4fa7-8ba5-949d5a201067) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-846c36bb-678f-4cf9-b586-9081dafd827e tempest-VolumesSnapshotTestJSON-1351489798 None] Created volume successfully. Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (f5d5c995-335f-4914-9c20-45d5d4d7fe32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2def753-2fb4-4853-8571-79e216b7676d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e2def753-2fb4-4853-8571-79e216b7676d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1521662329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a47f82-7bf5-4b89-8eb6-f93bb977cf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:30Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69fd7a8-b873-4b72-8120-4a20ce30bb7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a69fd7a8-b873-4b72-8120-4a20ce30bb7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371ccad7-31f6-4ad9-98ac-db5bd54cdff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:30 devstack sudo[96909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf Sep 03 11:59:30 devstack sudo[96909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (371ccad7-31f6-4ad9-98ac-db5bd54cdff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05a47f82-7bf5-4b89-8eb6-f93bb977cf5f', 'volume_name': 'volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2dc01e-4669-4aad-a5cf-e6d4e3b27c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7e2dc01e-4669-4aad-a5cf-e6d4e3b27c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba44d50-eca0-48cd-aa83-3e929910dbe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:30 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Volume 05a47f82-7bf5-4b89-8eb6-f93bb977cf5f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f', 'volume_size': 1} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1521662329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05a47f82-7bf5-4b89-8eb6-f93bb977cf5f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:30Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Creating volume 05a47f82-7bf5-4b89-8eb6-f93bb977cf5f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:30 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:30 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f 1073741824 Sep 03 11:59:30 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:30 devstack sudo[96909]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" returned: 0 in 0.507s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a17eaeb3-5d68-420a-8ed8-d168a987b071(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f155c23b-8704-433d-9750-2ac24eedf462]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:30 devstack sudo[96919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 Sep 03 11:59:30 devstack sudo[96919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:30 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f 1073741824" returned: 0 in 0.517s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:30 devstack sudo[96921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f Sep 03 11:59:30 devstack sudo[96921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:30 devstack sudo[96919]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071" returned: 0 in 0.429s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:30 devstack sudo[96926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf Sep 03 11:59:30 devstack sudo[96926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:30 devstack sudo[96921]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f" returned: 0 in 0.318s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] <== create_volume: return (889ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.624s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ba44d50-eca0-48cd-aa83-3e929910dbe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33a9a67-1faf-492f-bddc-1765ba05aa8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Creating offline snapshot 439bbce6-3f5c-4400-b810-8cafb7fa4bd1 of volume 662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:59:31 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Volume volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f (05a47f82-7bf5-4b89-8eb6-f93bb977cf5f): created successfully Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d33a9a67-1faf-492f-bddc-1765ba05aa8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (f5d5c995-335f-4914-9c20-45d5d4d7fe32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e65daf40-4b10-44b3-b705-7ba43f87eef3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-58a3d450-e728-4520-a7dc-821fed61cac5 tempest-VolumesActionsTest-1301100783 None] Created volume successfully. Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Flow 'volume_create_manager' (f3b9866d-8233-4b66-b2ca-aeed85be195b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b1ca87-997b-48a7-bac3-61dca0cd477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:31 devstack sudo[96929]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 Sep 03 11:59:31 devstack sudo[96929]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34b1ca87-997b-48a7-bac3-61dca0cd477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-380549362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560c04db-d119-4cad-aaf0-5b803baf6e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c1df9cd2864f259f870be7fe24088f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:31Z,use_quota=True,user_id='44871a374e70422882b7027e93af15ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9e700-a7c5-48bd-aa0e-12f1a0779193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fe9e700-a7c5-48bd-aa0e-12f1a0779193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109e1a00-4405-4849-80f7-00d3bac04b17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (109e1a00-4405-4849-80f7-00d3bac04b17) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '560c04db-d119-4cad-aaf0-5b803baf6e93', 'volume_name': 'volume-560c04db-d119-4cad-aaf0-5b803baf6e93', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9abb1a1-1c5a-48bb-be48-fb36a09a04b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9abb1a1-1c5a-48bb-be48-fb36a09a04b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:31 devstack sudo[96926]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b03740-c0d8-415f-a790-18005fccd986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:31 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Volume 560c04db-d119-4cad-aaf0-5b803baf6e93: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-560c04db-d119-4cad-aaf0-5b803baf6e93', 'volume_size': 1} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" returned: 0 in 0.413s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:31 devstack sudo[96935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf Sep 03 11:59:31 devstack sudo[96935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:31 devstack sudo[96929]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:31 devstack sudo[96940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 1G Sep 03 11:59:31 devstack sudo[96940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:31 devstack sudo[96935]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071.db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-db50b8bf-7475-4ef3-9c12-2d6f4e9152bf" released by "_delete_snapshot" :: held 1.739s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-a17eaeb3-5d68-420a-8ed8-d168a987b071" released by "delete_snapshot" :: held 1.775s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:31 devstack cinder-volume[87256]: WARNING cinder.quota [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-152553258 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-152553258, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:59:31 devstack cinder-volume[87256]: WARNING cinder.quota [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-152553258 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-152553258, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['d4edd422-520f-4509-8353-dbcf29ffeb43', '1b4dfa67-ce11-43d4-b905-2dd5353a8fb2', '0737855e-df88-4b8f-9f28-98e158deb809', '52fda8bb-260c-4957-991b-3dbec6c415f7'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-127db5e2-e776-41fe-a9f3-139e32f0f61b tempest-GroupSnapshotsTest-1733960627 None] group_snapshot d4f7a1e9-c31f-4cba-983d-9bee87df6f64: deleted successfully Sep 03 11:59:31 devstack sudo[96940]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 1G" returned: 0 in 0.396s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662c94c5-ee76-49ea-9297-819a7924dd00 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:31 devstack sudo[96946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662c94c5-ee76-49ea-9297-819a7924dd00 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 Sep 03 11:59:31 devstack sudo[96946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:32 devstack sudo[96946]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-662c94c5-ee76-49ea-9297-819a7924dd00 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1" returned: 0 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:32 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 is being set with open permissions: ugo+rw Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:32 devstack sudo[96952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 Sep 03 11:59:32 devstack sudo[96952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Lock "cinder-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-quobyte-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2815a31-62b7-41df-899b-b027c5ebd3af]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:32 devstack sudo[96952]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1" returned: 0 in 0.315s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:32 devstack sudo[96954]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f Sep 03 11:59:32 devstack sudo[96954]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:32 devstack sudo[96957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.info Sep 03 11:59:32 devstack sudo[96957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "cinder-quobyte-a17eaeb3-5d68-420a-8ed8-d168a987b071" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-a17eaeb3-5d68-420a-8ed8-d168a987b071" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2808f6a7-0739-47b4-9fed-256527b82873]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:32 devstack sudo[96959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 Sep 03 11:59:32 devstack sudo[96959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:32 devstack sudo[96954]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f" returned: 0 in 0.474s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:32 devstack sudo[96968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f Sep 03 11:59:32 devstack sudo[96968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:32 devstack sudo[96957]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.info" returned: 0 in 0.343s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:32 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.info is being set with open permissions: ugo+rw Sep 03 11:59:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:32 devstack sudo[96970]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.info Sep 03 11:59:32 devstack sudo[96970]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:33 devstack sudo[96959]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071" returned: 0 in 0.449s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:33 devstack sudo[96968]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:33 devstack sudo[96977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071 Sep 03 11:59:33 devstack sudo[96977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f" released by "delete_volume" :: held 0.847s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:33 devstack sudo[96970]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.info" returned: 0 in 0.291s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.185s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.920s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-380549362',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=560c04db-d119-4cad-aaf0-5b803baf6e93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c1df9cd2864f259f870be7fe24088f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:31Z,use_quota=True,user_id='44871a374e70422882b7027e93af15ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Creating volume 560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:33 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:33 devstack sudo[96980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 1073741824 Sep 03 11:59:33 devstack sudo[96980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-26cf4b01-9235-46c2-a60d-043ce981937b tempest-VolumesSnapshotTestJSON-1351489798 None] Create snapshot completed successfully Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Created reservations ['33db5898-5141-4c12-b539-1f9931d2105d', '75cf98e2-8538-4e97-a634-9d331074cc62', 'bf86e0bd-74f8-4971-abf9-9d406115460c', 'b4fabb46-cb7b-4f71-9628-5b602df0a2a5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:33 devstack sudo[96983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:33 devstack sudo[96983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:33 devstack sudo[96977]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a17eaeb3-5d68-420a-8ed8-d168a987b071" returned: 0 in 0.326s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Lock "cinder-quobyte-a17eaeb3-5d68-420a-8ed8-d168a987b071" released by "delete_volume" :: held 0.856s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['7aea16ea-1c6d-4574-98b1-a1691e361bf8'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:33 devstack cinder-volume[87256]: WARNING cinder.quota [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-152553258 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-152553258, it is now deprecated. Please use the default quota class for default quota. Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Created reservations ['445b2a35-27ed-407d-88c0-e82d2023d334', '00734339-6c00-4631-8fbf-898409aaf788', 'a431a7d3-f074-415d-9ed6-017a99011235', 'aa596ada-944c-4842-8407-4051cdc8d82b'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:33 devstack sudo[96983]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.331s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Deleted volume successfully. Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9f921a01-8d84-4e82-bca5-d634a0bc67c1 tempest-VolumesActionsTest-481777542 None] Lock "cinder-05a47f82-7bf5-4b89-8eb6-f93bb977cf5f-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:33 devstack sudo[96980]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 1073741824" returned: 0 in 0.621s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:33 devstack sudo[96990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:33 devstack sudo[96990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:33 devstack sudo[96992]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 Sep 03 11:59:33 devstack sudo[96992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:34 devstack sudo[96990]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.311s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-32ffaf1e-75a4-4544-a607-52abff33b306 tempest-GroupSnapshotsTest-1733960627 None] Delete group completed successfully. Sep 03 11:59:34 devstack sudo[96992]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.085s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98b03740-c0d8-415f-a790-18005fccd986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-560c04db-d119-4cad-aaf0-5b803baf6e93', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6313b12a-1a23-4c0c-af1e-c362e9037d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Volume volume-560c04db-d119-4cad-aaf0-5b803baf6e93 (560c04db-d119-4cad-aaf0-5b803baf6e93): created successfully Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6313b12a-1a23-4c0c-af1e-c362e9037d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Flow 'volume_create_manager' (f3b9866d-8233-4b66-b2ca-aeed85be195b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6d503c9d-4074-4366-8720-2e50a1bcfb25 tempest-VolumesCloneTest-5265325 None] Created volume successfully. Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (9790d524-8d59-48a0-97ce-f10f7616f83f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56932c1b-91ce-41a0-9ec8-548858d92357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (56932c1b-91ce-41a0-9ec8-548858d92357) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666283252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a805c5be-3431-4987-90f0-ea83b41fb82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:34Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0deb52c-4bab-43b2-b901-76dc99f6fde9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0deb52c-4bab-43b2-b901-76dc99f6fde9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39ae716-0088-4ae2-bccf-a3207eb41bcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a39ae716-0088-4ae2-bccf-a3207eb41bcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a805c5be-3431-4987-90f0-ea83b41fb82b', 'volume_name': 'volume-a805c5be-3431-4987-90f0-ea83b41fb82b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd58430-7357-4473-a5ca-cac9e3ddd5dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6cd58430-7357-4473-a5ca-cac9e3ddd5dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b95502-4619-4af6-af13-f003ebbbe756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Volume a805c5be-3431-4987-90f0-ea83b41fb82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a805c5be-3431-4987-90f0-ea83b41fb82b', 'volume_size': 1} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1666283252',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a805c5be-3431-4987-90f0-ea83b41fb82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:34Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Creating volume a805c5be-3431-4987-90f0-ea83b41fb82b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:34 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:34 devstack sudo[96996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b 1073741824 Sep 03 11:59:34 devstack sudo[96996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (3092bf3e-87d2-466b-ad8a-457bca7e75d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773a45d5-db54-4de6-b36f-6a88ce47b2bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (773a45d5-db54-4de6-b36f-6a88ce47b2bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-166447982',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4a9b966e-ffc5-4a1e-978b-230261bc28b3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:34Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=439bbce6-3f5c-4400-b810-8cafb7fa4bd1,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:34Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73672877-b5ed-4e62-86da-d22427fc3bff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (73672877-b5ed-4e62-86da-d22427fc3bff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5339a85-fc37-4e97-9ac9-1cb7ed6d5ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5339a85-fc37-4e97-9ac9-1cb7ed6d5ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4a9b966e-ffc5-4a1e-978b-230261bc28b3', 'volume_name': 'volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3', 'volume_size': 2, 'snapshot_id': '439bbce6-3f5c-4400-b810-8cafb7fa4bd1'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b3fc2-b13b-48c3-9360-d3ee4e8c5bc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (da7b3fc2-b13b-48c3-9360-d3ee4e8c5bc1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed646ae-9a7a-4d29-bfb0-aea72f54bd60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume 4a9b966e-ffc5-4a1e-978b-230261bc28b3: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3', 'volume_size': 2, 'snapshot_id': '439bbce6-3f5c-4400-b810-8cafb7fa4bd1'} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:34 devstack sudo[96996]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b 1073741824" returned: 0 in 0.445s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:35 devstack sudo[97002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b Sep 03 11:59:35 devstack sudo[97002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:35 devstack sudo[97002]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b" returned: 0 in 0.307s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.640s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-439bbce6-3f5c-4400-b810-8cafb7fa4bd1-4a9b966e-ffc5-4a1e-978b-230261bc28b3" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52b95502-4619-4af6-af13-f003ebbbe756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a805c5be-3431-4987-90f0-ea83b41fb82b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f703947-4268-48ed-af4f-70bffc72a36b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-439bbce6-3f5c-4400-b810-8cafb7fa4bd1-4a9b966e-ffc5-4a1e-978b-230261bc28b3" acquired by "_create_volume_from_snapshot" :: waited 0.054s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Creating volume 4a9b966e-ffc5-4a1e-978b-230261bc28b3 from snapshot 439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-4a9b966e-ffc5-4a1e-978b-230261bc28b3" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:35 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Volume volume-a805c5be-3431-4987-90f0-ea83b41fb82b (a805c5be-3431-4987-90f0-ea83b41fb82b): created successfully Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f703947-4268-48ed-af4f-70bffc72a36b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (9790d524-8d59-48a0-97ce-f10f7616f83f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-4a9b966e-ffc5-4a1e-978b-230261bc28b3" acquired by "_copy_volume_from_snapshot" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] snapshot: 439bbce6-3f5c-4400-b810-8cafb7fa4bd1, volume: 4a9b966e-ffc5-4a1e-978b-230261bc28b3, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:59:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-747752dc-923c-4a5b-a38c-227987d5a958 tempest-VolumesActionsTest-1301100783 None] Created volume successfully. Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7106ecbb-92f7-4e80-b280-cea446cd4e1c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:35 devstack sudo[97005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 Sep 03 11:59:35 devstack sudo[97005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:35 devstack sudo[97005]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1" returned: 0 in 0.435s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662c94c5-ee76-49ea-9297-819a7924dd00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c642e472-2f78-4ba1-a7ea-e024583c520b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Flow 'volume_create_manager' (35064022-7db7-4ee1-b11b-a6f8b404e9e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00785e94-a1b4-497e-a5ad-99f1a5965b01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00785e94-a1b4-497e-a5ad-99f1a5965b01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-861819583',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e313783b-2d16-4291-8c2e-47e61f610196,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='05c1df9cd2864f259f870be7fe24088f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:36Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=560c04db-d119-4cad-aaf0-5b803baf6e93,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:36Z,use_quota=True,user_id='44871a374e70422882b7027e93af15ba',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99c6763-b65a-4907-9b9c-6ed353e3491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c99c6763-b65a-4907-9b9c-6ed353e3491a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:36 devstack sudo[97010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 Sep 03 11:59:36 devstack sudo[97010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbe7d66-ac1c-4207-af9b-a173eaa1eea7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abbe7d66-ac1c-4207-af9b-a173eaa1eea7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'e313783b-2d16-4291-8c2e-47e61f610196', 'volume_name': 'volume-e313783b-2d16-4291-8c2e-47e61f610196', 'volume_size': 2, 'source_volid': '560c04db-d119-4cad-aaf0-5b803baf6e93', 'source_volstatus': 'available'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cc852f-e2ca-409b-9a8c-8ebc10afb021) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d1cc852f-e2ca-409b-9a8c-8ebc10afb021) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf983ed-8fee-4731-80a0-fd53ce98321d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:36 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Volume e313783b-2d16-4291-8c2e-47e61f610196: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-e313783b-2d16-4291-8c2e-47e61f610196', 'volume_size': 2, 'source_volid': '560c04db-d119-4cad-aaf0-5b803baf6e93', 'source_volstatus': 'available'} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:36 devstack sudo[97010]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00" returned: 0 in 0.470s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:36 devstack sudo[97015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 Sep 03 11:59:36 devstack sudo[97015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-a805c5be-3431-4987-90f0-ea83b41fb82b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Lock "cinder-a805c5be-3431-4987-90f0-ea83b41fb82b-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Acquiring lock "cinder-quobyte-a805c5be-3431-4987-90f0-ea83b41fb82b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-a805c5be-3431-4987-90f0-ea83b41fb82b" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[89e2e313-6034-41d8-ab41-4ea4ea66cd55]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:36 devstack sudo[97017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b Sep 03 11:59:36 devstack sudo[97017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:37 devstack sudo[97017]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b" returned: 0 in 0.650s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:37 devstack sudo[97032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b Sep 03 11:59:37 devstack sudo[97032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:38 devstack sudo[97032]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a805c5be-3431-4987-90f0-ea83b41fb82b" returned: 0 in 0.828s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Lock "cinder-quobyte-a805c5be-3431-4987-90f0-ea83b41fb82b" released by "delete_volume" :: held 1.531s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Created reservations ['f87eb139-4e01-41f0-8acb-d43ca533947e', '841a3037-b4c9-417c-8519-dd51f49c7af9', '28e4f6fd-3200-4317-977c-b7e7c1986e6f', 'e93044ff-ae35-4e11-9894-4567119a21cd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:38 devstack sudo[97036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:38 devstack sudo[97036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:39 devstack sudo[97036]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.970s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:39 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:39 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Deleted volume successfully. Sep 03 11:59:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ada1cbc7-66cc-4602-9031-6b0e3f6ee81e tempest-VolumesActionsTest-481777542 None] Lock "cinder-a805c5be-3431-4987-90f0-ea83b41fb82b-delete_volume" released by "delete_volume" :: held 2.971s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (fd48f3fe-4552-4e38-949c-28cebc12128d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723ec739-8cd1-4081-8451-31377e4fcd7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (723ec739-8cd1-4081-8451-31377e4fcd7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2052930293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4caf4e6-68cb-455d-9947-397612d91bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:40Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c372ff62-3495-496d-93a1-7ad9de350fe5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c372ff62-3495-496d-93a1-7ad9de350fe5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2463f109-cea5-460c-bfb6-a88eaa3e9cc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2463f109-cea5-460c-bfb6-a88eaa3e9cc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4caf4e6-68cb-455d-9947-397612d91bee', 'volume_name': 'volume-a4caf4e6-68cb-455d-9947-397612d91bee', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790b3a7c-1219-440d-b439-4bce09f6d5fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (790b3a7c-1219-440d-b439-4bce09f6d5fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f3adaf-cdf4-4a2c-83bb-0690f1955de8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:40 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Volume a4caf4e6-68cb-455d-9947-397612d91bee: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4caf4e6-68cb-455d-9947-397612d91bee', 'volume_size': 1} Sep 03 11:59:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:41 devstack sudo[97015]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3" returned: 0 in 5.494s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:41 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00, size 1024.00 MB, duration 5.49 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:59:41 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Converted 1024.00 MB image at 186.37 MB/s Sep 03 11:59:41 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 is being set with open permissions: ugo+rw Sep 03 11:59:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:41 devstack sudo[97046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 Sep 03 11:59:41 devstack sudo[97046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:42 devstack sudo[97046]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-4a9b966e-ffc5-4a1e-978b-230261bc28b3" released by "_copy_volume_from_snapshot" :: held 6.765s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0096ba1e-701b-42d2-b2b1-6e32c27e6df2 tempest-GroupSnapshotsV319Test-1500904668 None] Group tempest-GroupSnapshotsV319Test-Group-1197406987: creating Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-439bbce6-3f5c-4400-b810-8cafb7fa4bd1-4a9b966e-ffc5-4a1e-978b-230261bc28b3" released by "_create_volume_from_snapshot" :: held 6.873s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.928s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 6.105s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:42 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Cloning volume 560c04db-d119-4cad-aaf0-5b803baf6e93 to volume e313783b-2d16-4291-8c2e-47e61f610196 Sep 03 11:59:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0096ba1e-701b-42d2-b2b1-6e32c27e6df2 tempest-GroupSnapshotsV319Test-1500904668 None] Group tempest-GroupSnapshotsV319Test-Group-1197406987: created successfully Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed646ae-9a7a-4d29-bfb0-aea72f54bd60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3', 'volume_size': 2, 'snapshot_id': '439bbce6-3f5c-4400-b810-8cafb7fa4bd1'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333a8ebc-d739-40ab-b0bf-ab1d7ad85324) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0096ba1e-701b-42d2-b2b1-6e32c27e6df2 tempest-GroupSnapshotsV319Test-1500904668 None] Create group completed successfully. Sep 03 11:59:42 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 (4a9b966e-ffc5-4a1e-978b-230261bc28b3): created successfully Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (333a8ebc-d739-40ab-b0bf-ab1d7ad85324) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (3092bf3e-87d2-466b-ad8a-457bca7e75d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Creating offline snapshot d23dd0e9-b3f3-4456-b501-a6d59be8dc08 of volume 560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[80186868-dd6a-4651-8648-4dde31e08fa9]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-129da82b-c771-41c8-8d7e-b255c111a610 tempest-VolumesSnapshotTestJSON-1351489798 None] Created volume successfully. Sep 03 11:59:42 devstack sudo[97050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 Sep 03 11:59:42 devstack sudo[97050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:42 devstack sudo[97050]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93" returned: 0 in 0.350s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:42 devstack sudo[97055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 1G Sep 03 11:59:42 devstack sudo[97055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:43 devstack sudo[97055]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 1G" returned: 0 in 0.377s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560c04db-d119-4cad-aaf0-5b803baf6e93 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:43 devstack sudo[97061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560c04db-d119-4cad-aaf0-5b803baf6e93 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 Sep 03 11:59:43 devstack sudo[97061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-4a9b966e-ffc5-4a1e-978b-230261bc28b3-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-4a9b966e-ffc5-4a1e-978b-230261bc28b3-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-4a9b966e-ffc5-4a1e-978b-230261bc28b3" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-4a9b966e-ffc5-4a1e-978b-230261bc28b3" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9402bd4-90bb-46ea-adc4-488e3950ac61]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:43 devstack sudo[97061]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-560c04db-d119-4cad-aaf0-5b803baf6e93 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08" returned: 0 in 0.326s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:43 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 is being set with open permissions: ugo+rw Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:43 devstack sudo[97068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 Sep 03 11:59:43 devstack sudo[97068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:43 devstack sudo[97066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 Sep 03 11:59:43 devstack sudo[97066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:43 devstack sudo[97068]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08" returned: 0 in 0.302s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:43 devstack sudo[97066]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3" returned: 0 in 0.440s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:43 devstack sudo[97075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.info Sep 03 11:59:43 devstack sudo[97075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:43 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3 Sep 03 11:59:43 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Flow 'volume_create_manager' (8bddd839-6f6b-4562-aaac-a572333d7a4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a15b11-3f9b-4ce5-8814-b82e3cc807f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27a15b11-3f9b-4ce5-8814-b82e3cc807f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182739711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0d089c1-7d6d-4dd9-b9c0-efb20d1f49dc,host='devstack@QuobyteHD#QuobyteHD',id=5e70c690-7048-47cf-a161-67e89735869f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8534ad7840a4acb9dd89eeb2c8a6335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:44Z,use_quota=True,user_id='7722b057a3fa4072a271f35ef9a26ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd5fb36c-0bda-4f28-8086-db5236e023b7),volume_type_id=cd5fb36c-0bda-4f28-8086-db5236e023b7)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d4179d-a329-4b70-8eab-7236069ad955) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00d4179d-a329-4b70-8eab-7236069ad955) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eca5176-a688-4485-adc4-444bd74dbcf5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5eca5176-a688-4485-adc4-444bd74dbcf5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5e70c690-7048-47cf-a161-67e89735869f', 'volume_name': 'volume-5e70c690-7048-47cf-a161-67e89735869f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5ea524-dc03-4e5c-a9b6-34c213c963f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a5ea524-dc03-4e5c-a9b6-34c213c963f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608988fd-ffd8-4e17-a69b-cc33fb4be272) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:43 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Volume 5e70c690-7048-47cf-a161-67e89735869f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5e70c690-7048-47cf-a161-67e89735869f', 'volume_size': 1} Sep 03 11:59:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:44 devstack sudo[97075]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.info" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:44 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.info is being set with open permissions: ugo+rw Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:44 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:44 devstack sudo[97081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.info Sep 03 11:59:44 devstack sudo[97081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4a9b966e-ffc5-4a1e-978b-230261bc28b3" returned: 0 in 0.301s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-4a9b966e-ffc5-4a1e-978b-230261bc28b3" released by "delete_volume" :: held 0.788s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['0b967149-0f11-4de0-b147-c6a2c1a8309b', '17daaf88-0cb0-4620-8a24-c6626393f57e', 'ab554248-6ee7-495f-811b-8dade9428824', '77d7454c-616e-431b-84b2-351b9b44b15c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:44 devstack sudo[97083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:44 devstack sudo[97083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:44 devstack sudo[97081]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.info" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Acquiring lock "cinder-quobyte-e313783b-2d16-4291-8c2e-47e61f610196" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-e313783b-2d16-4291-8c2e-47e61f610196" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] snapshot: d23dd0e9-b3f3-4456-b501-a6d59be8dc08, volume: e313783b-2d16-4291-8c2e-47e61f610196, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4ac8b5-9e02-4ae4-aea9-1b62f3474ba7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-439bbce6-3f5c-4400-b810-8cafb7fa4bd1-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:44 devstack sudo[97083]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.266s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-439bbce6-3f5c-4400-b810-8cafb7fa4bd1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-662c94c5-ee76-49ea-9297-819a7924dd00" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:44 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Deleted volume successfully. Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-662c94c5-ee76-49ea-9297-819a7924dd00" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-439bbce6-3f5c-4400-b810-8cafb7fa4bd1" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3de88334-b261-4279-90d7-a951ec4ab7b8 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-4a9b966e-ffc5-4a1e-978b-230261bc28b3-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-439bbce6-3f5c-4400-b810-8cafb7fa4bd1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Deleting offline snapshot 439bbce6-3f5c-4400-b810-8cafb7fa4bd1 of volume 662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] snapshot_file for this snap is: volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:59:44 devstack sudo[97086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 Sep 03 11:59:44 devstack sudo[97086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae7cc8a1-613a-46ed-8e7f-150b39761259]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:44 devstack sudo[97089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 Sep 03 11:59:44 devstack sudo[97089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:44 devstack sudo[97086]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08" returned: 0 in 0.411s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560c04db-d119-4cad-aaf0-5b803baf6e93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[589b8760-1542-4d8b-b825-eb60ac6d20c1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:44 devstack sudo[97094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 Sep 03 11:59:44 devstack sudo[97094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:44 devstack sudo[97089]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1" returned: 0 in 0.397s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-662c94c5-ee76-49ea-9297-819a7924dd00(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[883bd177-966c-4150-aa02-bff6a7a56998]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:45 devstack sudo[97099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 Sep 03 11:59:45 devstack sudo[97099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:45 devstack sudo[97094]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93" returned: 0 in 0.373s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:45 devstack sudo[97104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 Sep 03 11:59:45 devstack sudo[97104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:45 devstack sudo[97099]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00" returned: 0 in 0.557s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:45 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 Sep 03 11:59:45 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:46 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1" returned: 0 in 0.599s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:46 devstack sudo[97124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1 Sep 03 11:59:46 devstack sudo[97124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:46 devstack sudo[97124]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00.439bbce6-3f5c-4400-b810-8cafb7fa4bd1" returned: 0 in 0.820s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-439bbce6-3f5c-4400-b810-8cafb7fa4bd1" released by "_delete_snapshot" :: held 2.549s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-662c94c5-ee76-49ea-9297-819a7924dd00" released by "delete_snapshot" :: held 2.599s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:47 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['d93c2e58-7a79-4612-941f-3adfe5b707ff', '71bba7ba-47da-4dae-8c74-531d6150895a', '590faa11-424e-4299-b4af-eeca541dbb0c', '1a6891d7-8f64-4963-b118-5a5a764328ae'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:47 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Delete snapshot completed successfully. Sep 03 11:59:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-faf1b7f3-c2e0-4a88-aec9-a7bbdd920043 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-439bbce6-3f5c-4400-b810-8cafb7fa4bd1-delete_snapshot" released by "delete_snapshot" :: held 2.929s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-662c94c5-ee76-49ea-9297-819a7924dd00-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-662c94c5-ee76-49ea-9297-819a7924dd00-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-662c94c5-ee76-49ea-9297-819a7924dd00" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-662c94c5-ee76-49ea-9297-819a7924dd00" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[da2a85f9-2cb3-46fc-a408-8f611dca0d84]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:48 devstack sudo[97128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 Sep 03 11:59:48 devstack sudo[97128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:49 devstack sudo[97128]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00" returned: 0 in 0.801s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:49 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00 Sep 03 11:59:49 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:49 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-662c94c5-ee76-49ea-9297-819a7924dd00" returned: 0 in 0.787s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-662c94c5-ee76-49ea-9297-819a7924dd00" released by "delete_volume" :: held 1.746s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['59b34aa2-cd9a-4636-9ab9-bbeed621a9a1', 'f590b203-1b0b-40b3-9090-80234b352bbc', '2ad5cca8-4330-4885-95a0-b626f807855d', '4bacb9df-ceaa-42e6-8245-54aead3dfe31'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:50 devstack sudo[97104]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196" returned: 0 in 4.833s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93, size 1024.00 MB, duration 4.84 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 11:59:50 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Converted 1024.00 MB image at 211.72 MB/s Sep 03 11:59:50 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 is being set with open permissions: ugo+rw Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:50 devstack sudo[97136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 Sep 03 11:59:50 devstack sudo[97136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:50 devstack sudo[97138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:50 devstack sudo[97138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:50 devstack sudo[97136]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196" returned: 0 in 0.278s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:50 devstack sudo[97138]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-e313783b-2d16-4291-8c2e-47e61f610196" released by "_copy_volume_from_snapshot" :: held 5.994s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Deleted volume successfully. Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Acquiring lock "cinder-quobyte-d23dd0e9-b3f3-4456-b501-a6d59be8dc08" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e8a14c7f-11b8-4258-a366-04fc4bb04f02 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-662c94c5-ee76-49ea-9297-819a7924dd00-delete_volume" released by "delete_volume" :: held 2.374s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-d23dd0e9-b3f3-4456-b501-a6d59be8dc08" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Deleting offline snapshot d23dd0e9-b3f3-4456-b501-a6d59be8dc08 of volume 560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] snapshot_file for this snap is: volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0f90ebd8-2a0e-4a48-b2f3-815b9c94c850]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:50 devstack sudo[97142]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 Sep 03 11:59:50 devstack sudo[97142]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:50 devstack sudo[97142]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08" returned: 0 in 0.401s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-560c04db-d119-4cad-aaf0-5b803baf6e93(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a53c035c-15fe-4fe7-875e-842823924e3e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:50 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (e383ddd5-349b-4f1e-b16a-b512acbe8c6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708d7da1-9069-4d6f-a5f5-e45de5ee23d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:51 devstack sudo[97147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 Sep 03 11:59:51 devstack sudo[97147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (708d7da1-9069-4d6f-a5f5-e45de5ee23d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1936729974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a58e788-204b-4eef-b487-9e0b996bbdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:51Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c277b52d-d9b5-4db4-b936-e20239a7e6fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c277b52d-d9b5-4db4-b936-e20239a7e6fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b86dab-e533-4e33-9e43-9e9095fe51ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f0b86dab-e533-4e33-9e43-9e9095fe51ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a58e788-204b-4eef-b487-9e0b996bbdc1', 'volume_name': 'volume-9a58e788-204b-4eef-b487-9e0b996bbdc1', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a67b971-9542-467a-a818-1a2de7687fad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a67b971-9542-467a-a818-1a2de7687fad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27085aa0-50d3-47da-94e5-fb9f423ec926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume 9a58e788-204b-4eef-b487-9e0b996bbdc1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a58e788-204b-4eef-b487-9e0b996bbdc1', 'volume_size': 1} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:51 devstack sudo[97147]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93" returned: 0 in 0.569s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:51 devstack sudo[97153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 Sep 03 11:59:51 devstack sudo[97153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:51 devstack sudo[97153]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08" returned: 0 in 0.331s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:51 devstack sudo[97158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08 Sep 03 11:59:51 devstack sudo[97158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:52 devstack sudo[97158]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93.d23dd0e9-b3f3-4456-b501-a6d59be8dc08" returned: 0 in 0.256s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-d23dd0e9-b3f3-4456-b501-a6d59be8dc08" released by "_delete_snapshot" :: held 1.702s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=147,cinder:UPDATE=182,cinder:INSERT=43,cinder:DELETE=9 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 9.957s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.823s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2052930293',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4caf4e6-68cb-455d-9947-397612d91bee,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2767437f478c417d8c6c23ac8c6679a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:40Z,use_quota=True,user_id='0b12c4f21c374a138557427b6c2c5bae',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Creating volume a4caf4e6-68cb-455d-9947-397612d91bee {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:52 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf983ed-8fee-4731-80a0-fd53ce98321d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e313783b-2d16-4291-8c2e-47e61f610196', 'volume_size': 2, 'source_volid': '560c04db-d119-4cad-aaf0-5b803baf6e93', 'source_volstatus': 'available'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:52 devstack sudo[97161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee 1073741824 Sep 03 11:59:52 devstack sudo[97161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ff2d0b-8d7e-48f2-9689-175129447739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:52 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Volume volume-e313783b-2d16-4291-8c2e-47e61f610196 (e313783b-2d16-4291-8c2e-47e61f610196): created successfully Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09ff2d0b-8d7e-48f2-9689-175129447739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Flow 'volume_create_manager' (35064022-7db7-4ee1-b11b-a6f8b404e9e4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-446a47a4-b1b1-415e-be4d-f908db96e25e tempest-VolumesCloneTest-5265325 None] Created volume successfully. Sep 03 11:59:52 devstack sudo[97161]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee 1073741824" returned: 0 in 0.442s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:52 devstack sudo[97167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee Sep 03 11:59:52 devstack sudo[97167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Acquiring lock "cinder-e313783b-2d16-4291-8c2e-47e61f610196-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Lock "cinder-e313783b-2d16-4291-8c2e-47e61f610196-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Acquiring lock "cinder-quobyte-e313783b-2d16-4291-8c2e-47e61f610196" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-e313783b-2d16-4291-8c2e-47e61f610196" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[428681d8-a7f2-402a-8beb-f2a9caa4e8cb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:52 devstack sudo[97169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 Sep 03 11:59:52 devstack sudo[97169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:52 devstack sudo[97167]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee" returned: 0 in 0.278s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.004s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d0d089c1-7d6d-4dd9-b9c0-efb20d1f49dc,created_at=2026-09-03T09:59:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-182739711',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d0d089c1-7d6d-4dd9-b9c0-efb20d1f49dc,host='devstack@QuobyteHD#QuobyteHD',id=5e70c690-7048-47cf-a161-67e89735869f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8534ad7840a4acb9dd89eeb2c8a6335',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:44Z,use_quota=True,user_id='7722b057a3fa4072a271f35ef9a26ec4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(cd5fb36c-0bda-4f28-8086-db5236e023b7),volume_type_id=cd5fb36c-0bda-4f28-8086-db5236e023b7)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Creating volume 5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:52 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1f3adaf-cdf4-4a2c-83bb-0690f1955de8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4caf4e6-68cb-455d-9947-397612d91bee', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0fa1b5-3e36-4780-874f-c90661297b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:53 devstack sudo[97172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f 1073741824 Sep 03 11:59:53 devstack sudo[97172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Volume volume-a4caf4e6-68cb-455d-9947-397612d91bee (a4caf4e6-68cb-455d-9947-397612d91bee): created successfully Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af0fa1b5-3e36-4780-874f-c90661297b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Flow 'volume_create_manager' (fd48f3fe-4552-4e38-949c-28cebc12128d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:53 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1c1562c4-ca30-44fd-b316-259ff2290a96 tempest-VolumesActionsTest-1301100783 None] Created volume successfully. Sep 03 11:59:53 devstack sudo[97169]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196" returned: 0 in 0.388s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:53 devstack sudo[97179]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196 Sep 03 11:59:53 devstack sudo[97179]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:53 devstack sudo[97172]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f 1073741824" returned: 0 in 0.483s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:53 devstack sudo[97179]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e313783b-2d16-4291-8c2e-47e61f610196" returned: 0 in 0.306s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:53 devstack sudo[97185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f Sep 03 11:59:53 devstack sudo[97185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-e313783b-2d16-4291-8c2e-47e61f610196" released by "delete_volume" :: held 0.747s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Created reservations ['4daa1c84-2ab6-425f-99c6-25d8a3af6b15', 'b99e64df-f35a-4c0d-af9e-68df39564d42', 'cd2192e9-3287-4c19-bbbc-c102f1c86a0b', '3efec879-4a0a-4f19-85b4-01819134a812'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=174,cinder:SELECT=179,cinder:INSERT=46,cinder:DELETE=12 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:53 devstack sudo[97187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:53 devstack sudo[97187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:53 devstack sudo[97185]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] <== create_volume: return (826ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.829s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.737s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1936729974',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a58e788-204b-4eef-b487-9e0b996bbdc1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:51Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Creating volume 9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 11:59:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (608988fd-ffd8-4e17-a69b-cc33fb4be272) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5e70c690-7048-47cf-a161-67e89735869f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:53 devstack sudo[97190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 1073741824 Sep 03 11:59:53 devstack sudo[97190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab19703a-a215-4528-b52c-f4aeb2b79b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Acquiring lock "cinder-a4caf4e6-68cb-455d-9947-397612d91bee-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Lock "cinder-a4caf4e6-68cb-455d-9947-397612d91bee-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Volume volume-5e70c690-7048-47cf-a161-67e89735869f (5e70c690-7048-47cf-a161-67e89735869f): created successfully Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab19703a-a215-4528-b52c-f4aeb2b79b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Flow 'volume_create_manager' (8bddd839-6f6b-4562-aaac-a572333d7a4b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:53 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f6f4be99-0704-45fb-b22a-af97c269c383 tempest-GroupSnapshotsV319Test-1500904668 None] Created volume successfully. Sep 03 11:59:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Acquiring lock "cinder-quobyte-a4caf4e6-68cb-455d-9947-397612d91bee" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Lock "cinder-quobyte-a4caf4e6-68cb-455d-9947-397612d91bee" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Acquiring lock "cinder-560c04db-d119-4cad-aaf0-5b803baf6e93-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:54 devstack sudo[97187]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Lock "cinder-560c04db-d119-4cad-aaf0-5b803baf6e93-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[01780a2c-b978-463e-ab87-04eab9c97a98]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.392s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Deleted volume successfully. Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Acquiring lock "cinder-quobyte-560c04db-d119-4cad-aaf0-5b803baf6e93" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20c53c5c-3e7b-4d10-9226-98fb5984c04c tempest-VolumesCloneTest-5265325 None] Lock "cinder-e313783b-2d16-4291-8c2e-47e61f610196-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-560c04db-d119-4cad-aaf0-5b803baf6e93" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[80860d98-a5dd-4579-b0f5-8ec981f28c5a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:54 devstack sudo[97193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee Sep 03 11:59:54 devstack sudo[97193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:54 devstack sudo[97197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 Sep 03 11:59:54 devstack sudo[97197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:54 devstack sudo[97190]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 1073741824" returned: 0 in 0.550s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:54 devstack sudo[97203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 Sep 03 11:59:54 devstack sudo[97203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:54 devstack sudo[97193]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee" returned: 0 in 0.407s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:54 devstack sudo[97206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee Sep 03 11:59:54 devstack sudo[97206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:54 devstack sudo[97197]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93" returned: 0 in 0.408s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:54 devstack sudo[97211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93 Sep 03 11:59:54 devstack sudo[97211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:54 devstack sudo[97203]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1" returned: 0 in 0.272s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] <== create_volume: return (871ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.875s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (27085aa0-50d3-47da-94e5-fb9f423ec926) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a58e788-204b-4eef-b487-9e0b996bbdc1', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f65223-a62b-4faa-b4b0-1de6032dfe38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:54 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 (9a58e788-204b-4eef-b487-9e0b996bbdc1): created successfully Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8f65223-a62b-4faa-b4b0-1de6032dfe38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (e383ddd5-349b-4f1e-b16a-b512acbe8c6f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f662b6a9-16f8-4531-9c16-7f681bd5c2f9 tempest-VolumesSnapshotTestJSON-1351489798 None] Created volume successfully. Sep 03 11:59:54 devstack sudo[97206]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4caf4e6-68cb-455d-9947-397612d91bee" returned: 0 in 0.292s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Lock "cinder-quobyte-a4caf4e6-68cb-455d-9947-397612d91bee" released by "delete_volume" :: held 0.781s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Created reservations ['1b30dc7d-b0e1-41ee-990d-321a9bedb86b', 'c5a2edcb-e2ba-4f7d-a710-dc1a7bb5c1c4', '55096f57-54fa-4d3f-8cdb-0afc20171ca6', 'aafe6d9d-d0ea-4f9e-a36a-17bd4e4ca461'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:54 devstack sudo[97211]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-560c04db-d119-4cad-aaf0-5b803baf6e93" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Lock "cinder-quobyte-560c04db-d119-4cad-aaf0-5b803baf6e93" released by "delete_volume" :: held 0.745s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:54 devstack sudo[97216]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:54 devstack sudo[97216]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:54 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Created reservations ['1f9cba45-0da5-41bc-82a7-3f73f63c8ec4', 'a6ea3893-198f-4655-b7fe-dce09e00c144', '64884a3a-a4be-486f-aaae-fe22ed608153', '55695f7e-561e-4885-98e9-1460ee591728'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 11:59:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] GroupSnapshot e125ce6f-2afb-43d9-b8c8-2ad9af3696a4: creating. Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Group snapshot e125ce6f-2afb-43d9-b8c8-2ad9af3696a4: creating. {{(pid=87256) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Sep 03 11:59:55 devstack sudo[97218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 11:59:55 devstack sudo[97218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Creating offline snapshot 82b20104-5a48-471f-95d2-2c27670cedba of volume 5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[64600b8a-f7af-4353-8dc7-953316974955]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:55 devstack sudo[97216]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Deleted volume successfully. Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-aa439427-9910-433b-be1c-ed63540b2efe tempest-VolumesActionsTest-1301100783 None] Lock "cinder-a4caf4e6-68cb-455d-9947-397612d91bee-delete_volume" released by "delete_volume" :: held 1.493s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:55 devstack sudo[97221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f Sep 03 11:59:55 devstack sudo[97221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:55 devstack sudo[97218]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.342s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 11:59:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Deleted volume successfully. Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eafad9c-284b-4261-be87-70ae87739fb5 tempest-VolumesCloneTest-5265325 None] Lock "cinder-560c04db-d119-4cad-aaf0-5b803baf6e93-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:55 devstack sudo[97221]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f" returned: 0 in 0.510s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:55 devstack sudo[97227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba 1G Sep 03 11:59:55 devstack sudo[97227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:56 devstack sudo[97227]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba 1G" returned: 0 in 0.525s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e70c690-7048-47cf-a161-67e89735869f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:56 devstack sudo[97233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e70c690-7048-47cf-a161-67e89735869f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba Sep 03 11:59:56 devstack sudo[97233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:56 devstack sudo[97233]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5e70c690-7048-47cf-a161-67e89735869f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba" returned: 0 in 0.359s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:56 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:56 devstack sudo[97239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba Sep 03 11:59:56 devstack sudo[97239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:56 devstack sudo[97239]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba" returned: 0 in 0.330s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:57 devstack sudo[97243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.info Sep 03 11:59:57 devstack sudo[97243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:57 devstack sudo[97243]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.info" returned: 0 in 0.269s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:57 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:57 devstack sudo[97246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.info Sep 03 11:59:57 devstack sudo[97246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:57 devstack sudo[97246]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.info" returned: 0 in 0.265s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.371s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.985s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Creating offline snapshot 570df70c-60b5-4ad5-a4e0-3c02bc541c38 of volume 9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[67bd9606-59e2-475a-83d0-42079044dedb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-578d922b-0b5c-408d-9fba-b9582e18be27 tempest-GroupSnapshotsV319Test-1500904668 None] group_snapshot e125ce6f-2afb-43d9-b8c8-2ad9af3696a4: created successfully Sep 03 11:59:57 devstack sudo[97249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 Sep 03 11:59:57 devstack sudo[97249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:58 devstack sudo[97249]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1" returned: 0 in 0.483s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:58 devstack sudo[97254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 1G Sep 03 11:59:58 devstack sudo[97254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:58 devstack sudo[97254]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 1G" returned: 0 in 0.515s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:58 devstack sudo[97260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 Sep 03 11:59:58 devstack sudo[97260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Flow 'volume_create_manager' (7a837197-9c7a-4128-ac0d-7cefeb9a61f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40f167e-e19c-4ed3-8ec7-f65fe61adb64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d40f167e-e19c-4ed3-8ec7-f65fe61adb64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1889602304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89773a40-8d7e-407c-80de-78bc0d3477e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9e6b99011e47df81391fb14575d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:59Z,use_quota=True,user_id='e6e913ea08304774997f255ac5d6a96a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b039cc36-be9e-479e-994b-2889d9b2a9df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b039cc36-be9e-479e-994b-2889d9b2a9df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f7d8d3-668a-4fcc-b419-68798f649740) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26f7d8d3-668a-4fcc-b419-68798f649740) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '89773a40-8d7e-407c-80de-78bc0d3477e9', 'volume_name': 'volume-89773a40-8d7e-407c-80de-78bc0d3477e9', 'volume_size': 2}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fec7c3a-f990-4d89-b846-5b3e99b3979d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fec7c3a-f990-4d89-b846-5b3e99b3979d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86935845-1e14-4b95-b12d-7d110d53d1dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 11:59:58 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Volume 89773a40-8d7e-407c-80de-78bc0d3477e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-89773a40-8d7e-407c-80de-78bc0d3477e9', 'volume_size': 2} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 11:59:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] group_snapshot e125ce6f-2afb-43d9-b8c8-2ad9af3696a4: deleting Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] group_snapshot e125ce6f-2afb-43d9-b8c8-2ad9af3696a4: deleting {{(pid=87256) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Acquiring lock "cinder-quobyte-5e70c690-7048-47cf-a161-67e89735869f" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "cinder-quobyte-5e70c690-7048-47cf-a161-67e89735869f" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Acquiring lock "cinder-quobyte-82b20104-5a48-471f-95d2-2c27670cedba" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "cinder-quobyte-82b20104-5a48-471f-95d2-2c27670cedba" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Deleting offline snapshot 82b20104-5a48-471f-95d2-2c27670cedba of volume 5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] snapshot_file for this snap is: volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec2f7d05-1108-4cdc-8f87-59a57f8111fc]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:59 devstack sudo[97260]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38" returned: 0 in 0.395s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:59 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 is being set with open permissions: ugo+rw Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:59 devstack sudo[97266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 Sep 03 11:59:59 devstack sudo[97266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:59 devstack sudo[97265]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba Sep 03 11:59:59 devstack sudo[97265]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:59 devstack sudo[97266]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38" returned: 0 in 0.319s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:59 devstack sudo[97273]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.info Sep 03 11:59:59 devstack sudo[97273]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:59 devstack sudo[97265]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba" returned: 0 in 0.487s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5e70c690-7048-47cf-a161-67e89735869f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2ab1cba-d260-4f9a-b5a4-c427a0a1a65c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:59 devstack sudo[97275]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f Sep 03 11:59:59 devstack sudo[97275]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:59 devstack sudo[97273]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.info" returned: 0 in 0.302s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:59 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.info is being set with open permissions: ugo+rw Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:59 devstack sudo[97278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.info Sep 03 11:59:59 devstack sudo[97278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 11:59:59 devstack sudo[97275]: pam_unix(sudo:session): session closed for user root Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f" returned: 0 in 0.402s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 11:59:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 11:59:59 devstack sudo[97284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba Sep 03 11:59:59 devstack sudo[97284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:00 devstack sudo[97278]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.info" returned: 0 in 0.322s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.453s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.268s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T09:59:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1889602304',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89773a40-8d7e-407c-80de-78bc0d3477e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ae9e6b99011e47df81391fb14575d9d1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T09:59:59Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T09:59:59Z,use_quota=True,user_id='e6e913ea08304774997f255ac5d6a96a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Creating volume 89773a40-8d7e-407c-80de-78bc0d3477e9 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:00 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 2147483648 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:00 devstack sudo[97287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 2147483648 Sep 03 12:00:00 devstack sudo[97287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a3c95d25-b740-4e94-b32e-aae652d61512 tempest-VolumesSnapshotTestJSON-1351489798 None] Create snapshot completed successfully Sep 03 12:00:00 devstack sudo[97284]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba" returned: 0 in 0.418s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:00 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba Sep 03 12:00:00 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:00 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f.82b20104-5a48-471f-95d2-2c27670cedba" returned: 0 in 0.265s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:00 devstack sudo[97287]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 2147483648" returned: 0 in 0.565s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "cinder-quobyte-82b20104-5a48-471f-95d2-2c27670cedba" released by "_delete_snapshot" :: held 1.707s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "cinder-quobyte-5e70c690-7048-47cf-a161-67e89735869f" released by "delete_snapshot" :: held 1.741s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:00 devstack sudo[97298]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 Sep 03 12:00:00 devstack sudo[97298]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:00 devstack cinder-volume[87256]: WARNING cinder.quota [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1558859427 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1558859427, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:00:00 devstack cinder-volume[87256]: WARNING cinder.quota [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1558859427 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1558859427, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] Created reservations ['2e98feef-77db-4671-9edd-490f7bbc4d70', '1314c122-b003-4ea3-9c5f-8ccd5a365643', 'd14dc0ea-4da4-4075-ab8a-3459eeaf1499', '7f1fc6b4-d917-4467-a716-d1e17a438a52'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-dd22d8ad-a29b-4ba0-9711-22aa86f08be3 tempest-GroupSnapshotsV319Test-1500904668 None] group_snapshot e125ce6f-2afb-43d9-b8c8-2ad9af3696a4: deleted successfully Sep 03 12:00:00 devstack sudo[97298]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9" returned: 0 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86935845-1e14-4b95-b12d-7d110d53d1dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89773a40-8d7e-407c-80de-78bc0d3477e9', 'volume_size': 2}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e7af31-f2fb-4e33-a472-1cfd21105c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:01 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Volume volume-89773a40-8d7e-407c-80de-78bc0d3477e9 (89773a40-8d7e-407c-80de-78bc0d3477e9): created successfully Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (36e7af31-f2fb-4e33-a472-1cfd21105c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Flow 'volume_create_manager' (7a837197-9c7a-4128-ac0d-7cefeb9a61f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d8faba5f-2fd5-45f3-bac3-df034cf0c562 tempest-VolumesCloneNegativeTest-1455395561 None] Created volume successfully. Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (3ddaa00f-8d1b-404c-93a6-0b2e7c347607) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac836228-26c1-4d70-906f-e7b9f69e9c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac836228-26c1-4d70-906f-e7b9f69e9c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1732528098',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52b44c24-b394-4880-91ee-a0c59b16b460,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ebaf1b0094f44d449c14bd0044778403',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=570df70c-60b5-4ad5-a4e0-3c02bc541c38,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:01Z,use_quota=True,user_id='d560f147433648468a8e0158b602cf72',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d79518-9060-41ae-87da-cfc023d0f45c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (56d79518-9060-41ae-87da-cfc023d0f45c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5633d40-f74d-4e9d-929f-2ba8802cc62c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5633d40-f74d-4e9d-929f-2ba8802cc62c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '52b44c24-b394-4880-91ee-a0c59b16b460', 'volume_name': 'volume-52b44c24-b394-4880-91ee-a0c59b16b460', 'volume_size': 1, 'snapshot_id': '570df70c-60b5-4ad5-a4e0-3c02bc541c38'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb3ff78-0f91-4ff9-b68c-b922c34c3f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fdb3ff78-0f91-4ff9-b68c-b922c34c3f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88714b55-f59e-4c76-a2cb-b0789daa463f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:01 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume 52b44c24-b394-4880-91ee-a0c59b16b460: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-52b44c24-b394-4880-91ee-a0c59b16b460', 'volume_size': 1, 'snapshot_id': '570df70c-60b5-4ad5-a4e0-3c02bc541c38'} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-570df70c-60b5-4ad5-a4e0-3c02bc541c38-52b44c24-b394-4880-91ee-a0c59b16b460" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Acquiring lock "cinder-quobyte-5e70c690-7048-47cf-a161-67e89735869f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "cinder-quobyte-5e70c690-7048-47cf-a161-67e89735869f" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-570df70c-60b5-4ad5-a4e0-3c02bc541c38-52b44c24-b394-4880-91ee-a0c59b16b460" acquired by "_create_volume_from_snapshot" :: waited 0.059s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Creating volume 52b44c24-b394-4880-91ee-a0c59b16b460 from snapshot 570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-52b44c24-b394-4880-91ee-a0c59b16b460" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a09f8e0d-6676-4a89-a5ec-2f7d63d10ddb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-52b44c24-b394-4880-91ee-a0c59b16b460" acquired by "_copy_volume_from_snapshot" :: waited 0.055s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] snapshot: 570df70c-60b5-4ad5-a4e0-3c02bc541c38, volume: 52b44c24-b394-4880-91ee-a0c59b16b460, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[766fcf65-af32-40e9-852f-a978366cad69]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:01 devstack sudo[97302]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f Sep 03 12:00:01 devstack sudo[97302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:01 devstack sudo[97304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 Sep 03 12:00:01 devstack sudo[97304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Acquiring lock "cinder-89773a40-8d7e-407c-80de-78bc0d3477e9-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "cinder-89773a40-8d7e-407c-80de-78bc0d3477e9-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Acquiring lock "cinder-quobyte-89773a40-8d7e-407c-80de-78bc0d3477e9" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "cinder-quobyte-89773a40-8d7e-407c-80de-78bc0d3477e9" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:02 devstack sudo[97302]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f" returned: 0 in 0.455s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[09764622-184f-4b6b-b81d-7a26459e2f74]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:02 devstack sudo[97310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f Sep 03 12:00:02 devstack sudo[97310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:02 devstack sudo[97311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 Sep 03 12:00:02 devstack sudo[97311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:02 devstack sudo[97304]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38" returned: 0 in 0.533s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a58e788-204b-4eef-b487-9e0b996bbdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[51e17103-f80e-4854-8fbb-cda6979b7a8c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:02 devstack sudo[97310]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5e70c690-7048-47cf-a161-67e89735869f" returned: 0 in 0.313s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "cinder-quobyte-5e70c690-7048-47cf-a161-67e89735869f" released by "delete_volume" :: held 0.857s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:02 devstack sudo[97318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 Sep 03 12:00:02 devstack sudo[97318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Created reservations ['f907d91b-f15d-4a5d-bcb5-9f7f98942ce7'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:02 devstack cinder-volume[87256]: WARNING cinder.quota [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1558859427 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1558859427, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Created reservations ['a6d1d6ac-b70f-485a-a323-64b27893e9a2', '0ac8a325-f786-46dd-a34d-98d376f456eb', '31917af1-b358-44b0-83ea-0bb390ef8bda', '7eba642e-7803-42ca-aa6c-6574e843016c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:02 devstack sudo[97311]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9" returned: 0 in 0.455s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:02 devstack sudo[97324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9 Sep 03 12:00:02 devstack sudo[97324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:02 devstack sudo[97318]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1" returned: 0 in 0.499s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:00:02 devstack sudo[97330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:02 devstack sudo[97330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:02 devstack sudo[97332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 Sep 03 12:00:02 devstack sudo[97332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:02 devstack sudo[97324]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-89773a40-8d7e-407c-80de-78bc0d3477e9" returned: 0 in 0.349s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "cinder-quobyte-89773a40-8d7e-407c-80de-78bc0d3477e9" released by "delete_volume" :: held 0.870s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Created reservations ['b7a0d802-3152-4e8d-91b1-8f13fbd54e25', 'c50a6cd5-1a5e-4b53-8dd6-b313f48f5966', 'de12514c-6e25-4033-b5e5-a4c9538cb4fc', 'e8df8f28-6724-4075-a84b-6aced8fb7812'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:03 devstack sudo[97330]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.342s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-052faf71-0d2e-4856-90e7-b887c4586dc7 tempest-GroupSnapshotsV319Test-1500904668 None] Delete group completed successfully. Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:03 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:03 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:03 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.626s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:03 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Deleted volume successfully. Sep 03 12:00:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7a7764fd-1e5b-4286-a942-400a04e75657 tempest-VolumesCloneNegativeTest-1455395561 None] Lock "cinder-89773a40-8d7e-407c-80de-78bc0d3477e9-delete_volume" released by "delete_volume" :: held 1.940s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:08 devstack sudo[97332]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460" returned: 0 in 5.698s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:08 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1, size 1024.00 MB, duration 5.70 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:00:08 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Converted 1024.00 MB image at 179.68 MB/s Sep 03 12:00:08 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 is being set with open permissions: ugo+rw Sep 03 12:00:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:08 devstack sudo[97354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 Sep 03 12:00:08 devstack sudo[97354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:08 devstack sudo[97354]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460" returned: 0 in 0.320s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-52b44c24-b394-4880-91ee-a0c59b16b460" released by "_copy_volume_from_snapshot" :: held 7.189s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-570df70c-60b5-4ad5-a4e0-3c02bc541c38-52b44c24-b394-4880-91ee-a0c59b16b460" released by "_create_volume_from_snapshot" :: held 7.308s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.368s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88714b55-f59e-4c76-a2cb-b0789daa463f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52b44c24-b394-4880-91ee-a0c59b16b460', 'volume_size': 1, 'snapshot_id': '570df70c-60b5-4ad5-a4e0-3c02bc541c38'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4c782b-a310-461d-9afb-21e342ced1ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:09 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Volume volume-52b44c24-b394-4880-91ee-a0c59b16b460 (52b44c24-b394-4880-91ee-a0c59b16b460): created successfully Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4b4c782b-a310-461d-9afb-21e342ced1ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Flow 'volume_create_manager' (3ddaa00f-8d1b-404c-93a6-0b2e7c347607) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-429cf95b-b0cc-4c78-b694-eb3b8f418532 tempest-VolumesSnapshotTestJSON-1351489798 None] Created volume successfully. Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-52b44c24-b394-4880-91ee-a0c59b16b460-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-52b44c24-b394-4880-91ee-a0c59b16b460-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-52b44c24-b394-4880-91ee-a0c59b16b460" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-52b44c24-b394-4880-91ee-a0c59b16b460" acquired by "delete_volume" :: waited 0.039s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[72e68ff6-1c7e-46a7-85d2-08003af02ea0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:09 devstack sudo[97357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 Sep 03 12:00:09 devstack sudo[97357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:10 devstack sudo[97357]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460" returned: 0 in 0.461s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:10 devstack sudo[97363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460 Sep 03 12:00:10 devstack sudo[97363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:10 devstack sudo[97363]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-52b44c24-b394-4880-91ee-a0c59b16b460" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-52b44c24-b394-4880-91ee-a0c59b16b460" released by "delete_volume" :: held 0.827s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['bc8e8795-851b-4ac8-954b-14596a567504', '169bc84c-61a9-4e20-886c-2efbdaa1bbce', '729d3ad4-53d8-4412-b7da-5c1edba3a625', 'ea29865c-908c-488e-a441-256c4a357aea'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:10 devstack sudo[97366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:10 devstack sudo[97366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-570df70c-60b5-4ad5-a4e0-3c02bc541c38-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-570df70c-60b5-4ad5-a4e0-3c02bc541c38-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-9a58e788-204b-4eef-b487-9e0b996bbdc1" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-9a58e788-204b-4eef-b487-9e0b996bbdc1" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-570df70c-60b5-4ad5-a4e0-3c02bc541c38" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-570df70c-60b5-4ad5-a4e0-3c02bc541c38" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Deleting offline snapshot 570df70c-60b5-4ad5-a4e0-3c02bc541c38 of volume 9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] snapshot_file for this snap is: volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[74b28450-6259-470f-8b84-922475d58e9d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:11 devstack sudo[97366]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.385s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Deleted volume successfully. Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a0e6543c-cdb1-46c0-bf27-7afb78279447 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-52b44c24-b394-4880-91ee-a0c59b16b460-delete_volume" released by "delete_volume" :: held 1.497s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:11 devstack sudo[97369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 Sep 03 12:00:11 devstack sudo[97369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:11 devstack sudo[97369]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38" returned: 0 in 0.496s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a58e788-204b-4eef-b487-9e0b996bbdc1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8dd8712-c1e2-4cd2-930b-64ff299e69ed]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:11 devstack sudo[97375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 Sep 03 12:00:11 devstack sudo[97375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:12 devstack sudo[97375]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1" returned: 0 in 0.796s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:12 devstack sudo[97380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 Sep 03 12:00:12 devstack sudo[97380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:12 devstack sudo[97380]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38" returned: 0 in 0.507s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:12 devstack sudo[97385]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38 Sep 03 12:00:12 devstack sudo[97385]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:13 devstack sudo[97385]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1.570df70c-60b5-4ad5-a4e0-3c02bc541c38" returned: 0 in 0.296s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-570df70c-60b5-4ad5-a4e0-3c02bc541c38" released by "_delete_snapshot" :: held 2.246s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-9a58e788-204b-4eef-b487-9e0b996bbdc1" released by "delete_snapshot" :: held 2.278s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Flow 'volume_create_manager' (9a54aa56-4e37-4e55-9d67-91170b981186) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b15b97d-10b1-4964-939c-566c636541ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b15b97d-10b1-4964-939c-566c636541ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1076961907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf51b6e6-47fe-44e1-a04a-3368f5bbaeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f4dc5dfe5c4bcd9ef3724d047d454e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:13Z,use_quota=True,user_id='37c04f6dc2c1460d9fcca422f47a6f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebf865b-4ce1-43a8-a9ba-fbc1149b57d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ebf865b-4ce1-43a8-a9ba-fbc1149b57d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df560edb-9c81-4aef-81e6-c586b4881395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['d0e7dc34-5c1e-4573-b9a8-4e99dbe8ca22', '4b7e9f53-a470-42c0-856c-9d439f8a89db', 'ce4a423c-3584-4acd-aa5d-76cf25aba920', '17c2feb2-e9bf-40a7-9ead-bcebd30ec95a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:13 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Delete snapshot completed successfully. Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a7022576-946d-4786-884a-9b0a3e7db8cc tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-570df70c-60b5-4ad5-a4e0-3c02bc541c38-delete_snapshot" released by "delete_snapshot" :: held 2.547s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df560edb-9c81-4aef-81e6-c586b4881395) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'bf51b6e6-47fe-44e1-a04a-3368f5bbaeda', 'volume_name': 'volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495906bf-4b1e-483e-8ba1-c4bfda766392) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (495906bf-4b1e-483e-8ba1-c4bfda766392) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c376bf30-b7cd-44b3-8302-22e46a3b6446) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:13 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Volume bf51b6e6-47fe-44e1-a04a-3368f5bbaeda: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 12:00:13 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Trying to clone bf51b6e6-47fe-44e1-a04a-3368f5bbaeda from image b9f83e66-733e-4378-86ef-e85be0416fc2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:00:14 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Image download 20.69 MB at 20.69 MB/s Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[763e91be-5f9d-4382-a5ec-e723d78a6f82]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-9a58e788-204b-4eef-b487-9e0b996bbdc1-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-9a58e788-204b-4eef-b487-9e0b996bbdc1-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-9a58e788-204b-4eef-b487-9e0b996bbdc1" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-9a58e788-204b-4eef-b487-9e0b996bbdc1" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:14 devstack sudo[97391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD Sep 03 12:00:14 devstack sudo[97391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7d6fb3c4-3eda-4f21-8164-d42d3ee6e324]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:14 devstack sudo[97393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 Sep 03 12:00:14 devstack sudo[97393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:14 devstack sudo[97391]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD" returned: 0 in 0.443s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 is fetched for user 37c04f6dc2c1460d9fcca422f47a6f82. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e2d8843-fa07-4ac7-a07f-eb20a5c22b19]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:14 devstack sudo[97393]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1" returned: 0 in 0.503s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:15 devstack sudo[97402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1 Sep 03 12:00:15 devstack sudo[97402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:15 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD Sep 03 12:00:15 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:15 devstack sudo[97402]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9a58e788-204b-4eef-b487-9e0b996bbdc1" returned: 0 in 0.290s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-9a58e788-204b-4eef-b487-9e0b996bbdc1" released by "delete_volume" :: held 0.875s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:15 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD" returned: 0 in 0.476s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1076961907',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf51b6e6-47fe-44e1-a04a-3368f5bbaeda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89f4dc5dfe5c4bcd9ef3724d047d454e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:13Z,use_quota=True,user_id='37c04f6dc2c1460d9fcca422f47a6f82',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Creating volume bf51b6e6-47fe-44e1-a04a-3368f5bbaeda {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:15 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['bc9add75-6c22-43fc-8307-dc2b3612874f', 'b5ba1cec-46f6-44be-ab05-2784f8e9d33b', '277b8d88-904b-4790-b0d6-d5c29697feea', 'dfae1931-e668-432e-bcb8-9fb192dc8502'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:15 devstack sudo[97409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda 1073741824 Sep 03 12:00:15 devstack sudo[97409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:15 devstack sudo[97411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:15 devstack sudo[97411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-fa1c9890-c4ee-47a0-b6d6-7579019712fe-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-fa1c9890-c4ee-47a0-b6d6-7579019712fe-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "cinder-quobyte-fa1c9890-c4ee-47a0-b6d6-7579019712fe" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-fa1c9890-c4ee-47a0-b6d6-7579019712fe" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:15 devstack sudo[97411]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.357s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Deleted volume successfully. Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a45d638d-4d80-4482-818b-7261b04a5fde]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a1fef927-30ad-4bf2-8d48-7446fbf95f46 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-9a58e788-204b-4eef-b487-9e0b996bbdc1-delete_volume" released by "delete_volume" :: held 1.640s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:16 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe Sep 03 12:00:16 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:16 devstack sudo[97409]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda 1073741824" returned: 0 in 0.797s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:16 devstack sudo[97420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:16 devstack sudo[97420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:16 devstack sudo[97422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda Sep 03 12:00:16 devstack sudo[97422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:16 devstack sudo[97420]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:16 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe" returned: 0 in 0.562s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:00:16 devstack sudo[97429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe Sep 03 12:00:16 devstack sudo[97429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:16 devstack sudo[97422]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda" returned: 0 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] <== create_volume: return (1271ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.276s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Attempting download of b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume bf51b6e6-47fe-44e1-a04a-3368f5bbaeda. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d08fd7c3-15d2-428b-aa12-539a6a957b39]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_r9_r9kjn {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:16 devstack sudo[97429]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fa1c9890-c4ee-47a0-b6d6-7579019712fe" returned: 0 in 0.341s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-quobyte-fa1c9890-c4ee-47a0-b6d6-7579019712fe" released by "delete_volume" :: held 1.004s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:16 devstack sudo[97432]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_r9_r9kjn Sep 03 12:00:16 devstack sudo[97432]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Created reservations ['21990c8a-9918-4447-bfd9-a0de10f40333', '4d08b5eb-d4da-4382-bcd5-0bc26f2b7c9f', '87d06799-9e1a-409a-93a6-fcfa9844446d', '9da0fa72-ef93-44a4-8a4a-44154bef56de'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:17 devstack sudo[97435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:17 devstack sudo[97435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:17 devstack sudo[97432]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_r9_r9kjn" returned: 0 in 0.422s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_r9_r9kjn {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:17 devstack sudo[97439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_r9_r9kjn Sep 03 12:00:17 devstack sudo[97439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:17 devstack sudo[97435]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.302s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:17 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Deleted volume successfully. Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ff2d4c1-646c-4563-8ef1-c8b38ac6ccc1 tempest-VolumesSnapshotTestJSON-1351489798 None] Lock "cinder-fa1c9890-c4ee-47a0-b6d6-7579019712fe-delete_volume" released by "delete_volume" :: held 1.657s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:17 devstack sudo[97439]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_r9_r9kjn" returned: 1 in 0.484s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_r9_r9kjn' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f544054-7087-4003-be47-6aa99e5ffa53]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:17 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD Sep 03 12:00:17 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:18 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD" returned: 0 in 0.469s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:18 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] b9f83e66-733e-4378-86ef-e85be0416fc2 was qcow2, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:00:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:18 devstack sudo[97450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda Sep 03 12:00:18 devstack sudo[97450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:20 devstack sudo[97450]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda" returned: 0 in 2.470s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:20 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_h9j9qlcudevstack@QuobyteHD, size 112.00 MB, duration 2.47 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:00:20 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Converted 112.00 MB image at 45.32 MB/s Sep 03 12:00:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:20 devstack sudo[97460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda 1G Sep 03 12:00:20 devstack sudo[97460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:21 devstack sudo[97460]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda 1G" returned: 0 in 0.464s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Downloaded image b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume bf51b6e6-47fe-44e1-a04a-3368f5bbaeda successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 for user 37c04f6dc2c1460d9fcca422f47a6f82 is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Marking volume bf51b6e6-47fe-44e1-a04a-3368f5bbaeda as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Copying metadata from image b9f83e66-733e-4378-86ef-e85be0416fc2 to bf51b6e6-47fe-44e1-a04a-3368f5bbaeda. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Creating volume glance metadata for volume bf51b6e6-47fe-44e1-a04a-3368f5bbaeda backed by image b9f83e66-733e-4378-86ef-e85be0416fc2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c376bf30-b7cd-44b3-8302-22e46a3b6446) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44add91-140c-46c6-a4de-bf405983e564) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:21 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Volume volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda (bf51b6e6-47fe-44e1-a04a-3368f5bbaeda): created successfully Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b44add91-140c-46c6-a4de-bf405983e564) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Flow 'volume_create_manager' (9a54aa56-4e37-4e55-9d67-91170b981186) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c4e545c3-6288-47db-a768-b2a3497d006e tempest-VolumesImageMetadata-1929928241 None] Created volume successfully. Sep 03 12:00:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-704bf144-e208-4054-86d1-9185dfa50720 tempest-GroupsTest-606302109 None] Group tempest-Group1-848783633: creating Sep 03 12:00:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-704bf144-e208-4054-86d1-9185dfa50720 tempest-GroupsTest-606302109 None] Group tempest-Group1-848783633: created successfully Sep 03 12:00:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-704bf144-e208-4054-86d1-9185dfa50720 tempest-GroupsTest-606302109 None] Create group completed successfully. Sep 03 12:00:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Acquiring lock "cinder-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Lock "cinder-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Acquiring lock "cinder-quobyte-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Lock "cinder-quobyte-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda" acquired by "delete_volume" :: waited 0.033s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:22 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ced21a4-3568-4e60-aa4f-fc9e05872158]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:22 devstack sudo[97502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda Sep 03 12:00:22 devstack sudo[97502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c27a1d63-5bf2-4d21-a3ee-35ecb6e5a465 tempest-GroupsTest-606302109 None] Group tempest-Group2-767967927: creating Sep 03 12:00:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c27a1d63-5bf2-4d21-a3ee-35ecb6e5a465 tempest-GroupsTest-606302109 None] Group tempest-Group2-767967927: created successfully Sep 03 12:00:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c27a1d63-5bf2-4d21-a3ee-35ecb6e5a465 tempest-GroupsTest-606302109 None] Create group completed successfully. Sep 03 12:00:23 devstack sudo[97502]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda" returned: 0 in 0.555s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:23 devstack sudo[97509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda Sep 03 12:00:23 devstack sudo[97509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:23 devstack sudo[97509]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda" returned: 0 in 0.309s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Lock "cinder-quobyte-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda" released by "delete_volume" :: held 0.969s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Created reservations ['bf27f12c-e730-4ec8-9cf2-dfce8c78d441', '522bc3a2-71e4-47af-9bf0-5246a03a5c51', 'cd9a08bf-91b4-4cbf-8d17-775d06c21308', 'ab1be626-dd51-4ee7-a850-e4b274a3f657'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:23 devstack sudo[97513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:23 devstack sudo[97513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:24 devstack sudo[97513]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.386s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:24 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Deleted volume successfully. Sep 03 12:00:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9a72d16-3a56-487e-bdd4-b718d6b4dcdd tempest-VolumesImageMetadata-1929928241 None] Lock "cinder-bf51b6e6-47fe-44e1-a04a-3368f5bbaeda-delete_volume" released by "delete_volume" :: held 1.686s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:24 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Flow 'volume_create_manager' (eccb812f-ea9b-4753-8227-65b8ceae6ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa4d99f-3932-4097-ab03-426befdd6470) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (faa4d99f-3932-4097-ab03-426befdd6470) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1755064830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e63c1d7-4a01-4ed0-a8eb-526de8976846,host='devstack@QuobyteHD#QuobyteHD',id=1be3107d-19c5-421a-9f1a-addb265a016a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0963e510904c3a8742b89e8c5a1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:25Z,use_quota=True,user_id='87b294530d7a4574913fb7edfe581af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10e032b1-b9ec-4daf-88e3-de84a50230db),volume_type_id=10e032b1-b9ec-4daf-88e3-de84a50230db)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4428fa2-d125-4101-bcb1-1bc13fc7820c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e4428fa2-d125-4101-bcb1-1bc13fc7820c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058a9113-403d-43ef-b259-97ea7e76a44e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (058a9113-403d-43ef-b259-97ea7e76a44e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1be3107d-19c5-421a-9f1a-addb265a016a', 'volume_name': 'volume-1be3107d-19c5-421a-9f1a-addb265a016a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950cbd5f-dbb9-4164-a789-78f641aceaad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (950cbd5f-dbb9-4164-a789-78f641aceaad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9956b9b0-d5c1-4cb6-a61c-eb1968b931c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Volume 1be3107d-19c5-421a-9f1a-addb265a016a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1be3107d-19c5-421a-9f1a-addb265a016a', 'volume_size': 1} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=8e63c1d7-4a01-4ed0-a8eb-526de8976846,created_at=2026-09-03T10:00:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1755064830',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=8e63c1d7-4a01-4ed0-a8eb-526de8976846,host='devstack@QuobyteHD#QuobyteHD',id=1be3107d-19c5-421a-9f1a-addb265a016a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0963e510904c3a8742b89e8c5a1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:25Z,use_quota=True,user_id='87b294530d7a4574913fb7edfe581af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(10e032b1-b9ec-4daf-88e3-de84a50230db),volume_type_id=10e032b1-b9ec-4daf-88e3-de84a50230db)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Creating volume 1be3107d-19c5-421a-9f1a-addb265a016a {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:25 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:25 devstack sudo[97517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a 1073741824 Sep 03 12:00:25 devstack sudo[97517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:25 devstack sudo[97517]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a 1073741824" returned: 0 in 0.622s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:25 devstack sudo[97523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a Sep 03 12:00:25 devstack sudo[97523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:26 devstack sudo[97523]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a" returned: 0 in 0.437s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] <== create_volume: return (1133ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.137s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9956b9b0-d5c1-4cb6-a61c-eb1968b931c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1be3107d-19c5-421a-9f1a-addb265a016a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac26df22-ae73-4982-bd27-97730e69e1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Volume volume-1be3107d-19c5-421a-9f1a-addb265a016a (1be3107d-19c5-421a-9f1a-addb265a016a): created successfully Sep 03 12:00:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ac26df22-ae73-4982-bd27-97730e69e1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Flow 'volume_create_manager' (eccb812f-ea9b-4753-8227-65b8ceae6ec3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3f7ced2b-8410-492b-b168-3398892d9474 tempest-GroupsTest-606302109 None] Created volume successfully. Sep 03 12:00:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Acquiring lock "cinder-quobyte-1be3107d-19c5-421a-9f1a-addb265a016a" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Lock "cinder-quobyte-1be3107d-19c5-421a-9f1a-addb265a016a" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:28 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[49c567f0-c27c-4436-8dc1-702028d977db]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:28 devstack sudo[97526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a Sep 03 12:00:28 devstack sudo[97526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:28 devstack sudo[97526]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a" returned: 0 in 0.569s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:28 devstack sudo[97531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a Sep 03 12:00:28 devstack sudo[97531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:29 devstack sudo[97531]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1be3107d-19c5-421a-9f1a-addb265a016a" returned: 0 in 0.284s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Lock "cinder-quobyte-1be3107d-19c5-421a-9f1a-addb265a016a" released by "delete_volume" :: held 0.930s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Created reservations ['1b294b53-92dd-45d5-9ba1-19ad5498837d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:29 devstack cinder-volume[87256]: WARNING cinder.quota [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1564723063 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1564723063, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:00:29 devstack cinder-volume[87256]: WARNING cinder.quota [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1564723063 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1564723063, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Created reservations ['81732454-556d-45fc-9f38-f49bc28196b2', '8a650ec8-6b01-4a8d-9fba-67676cdfacd4', '025a9961-e451-4527-a6cb-1bc1aed820fb', 'e9d077b9-37d3-4bb7-bd72-c9d691e3532f'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:29 devstack sudo[97534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:29 devstack sudo[97534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Flow 'volume_create_manager' (d3c5610c-d953-489a-833c-238e8289fc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ace77f-213f-4ea7-885a-443085574b6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5ace77f-213f-4ea7-885a-443085574b6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1010934979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38a4493-1da5-49a1-aa5b-226793afa94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa3cb1eade44d1e84b63548ce6c6c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:30Z,use_quota=True,user_id='d27f555417794330896be7ca8af59637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed3d402-e268-4c29-96c1-bcfdd1d4614d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eed3d402-e268-4c29-96c1-bcfdd1d4614d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc80af8-446f-44df-ae92-8d071b1cb779) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:29 devstack sudo[97534]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fdc80af8-446f-44df-ae92-8d071b1cb779) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f38a4493-1da5-49a1-aa5b-226793afa94b', 'volume_name': 'volume-f38a4493-1da5-49a1-aa5b-226793afa94b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab61c475-f7dd-4345-83ca-92065656b569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ab61c475-f7dd-4345-83ca-92065656b569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0891c0a-4eca-4750-8a99-82f68e3474c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Volume f38a4493-1da5-49a1-aa5b-226793afa94b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f38a4493-1da5-49a1-aa5b-226793afa94b', 'volume_size': 1} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-1010934979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f38a4493-1da5-49a1-aa5b-226793afa94b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1fa3cb1eade44d1e84b63548ce6c6c13',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:30Z,use_quota=True,user_id='d27f555417794330896be7ca8af59637',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Creating volume f38a4493-1da5-49a1-aa5b-226793afa94b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:29 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:29 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7ee3696e-4044-4861-9a19-bfdb87ae5417 tempest-GroupsTest-606302109 None] Delete group completed successfully. Sep 03 12:00:29 devstack sudo[97537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b 1073741824 Sep 03 12:00:29 devstack sudo[97537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:30 devstack sudo[97537]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b 1073741824" returned: 0 in 0.501s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:30 devstack sudo[97543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b Sep 03 12:00:30 devstack sudo[97543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Created reservations ['428ff4a7-8283-4cb4-a90a-075f6e10b3ca'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:30 devstack sudo[97543]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b" returned: 0 in 0.371s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] <== create_volume: return (927ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.930s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f0891c0a-4eca-4750-8a99-82f68e3474c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f38a4493-1da5-49a1-aa5b-226793afa94b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390aa8f4-75e1-4f4e-bb53-d47739b38ad9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:30 devstack sudo[97546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:30 devstack sudo[97546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:30 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Volume volume-f38a4493-1da5-49a1-aa5b-226793afa94b (f38a4493-1da5-49a1-aa5b-226793afa94b): created successfully Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (390aa8f4-75e1-4f4e-bb53-d47739b38ad9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Flow 'volume_create_manager' (d3c5610c-d953-489a-833c-238e8289fc08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-eefeac50-5f63-459a-b6d8-f3136221de3d tempest-AbsoluteLimitsTests-2008986697 None] Created volume successfully. Sep 03 12:00:31 devstack sudo[97546]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:31 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8318c0a8-4261-46ab-96d8-c92251bdb4e2 tempest-GroupsTest-606302109 None] Delete group completed successfully. Sep 03 12:00:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Acquiring lock "cinder-f38a4493-1da5-49a1-aa5b-226793afa94b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Lock "cinder-f38a4493-1da5-49a1-aa5b-226793afa94b-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Acquiring lock "cinder-quobyte-f38a4493-1da5-49a1-aa5b-226793afa94b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Lock "cinder-quobyte-f38a4493-1da5-49a1-aa5b-226793afa94b" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d7af8e2-f3b0-4bde-abcb-c7539c67fe95]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:32 devstack sudo[97551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b Sep 03 12:00:32 devstack sudo[97551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-af3f8a3b-f84d-437a-b166-edd55fa3df54 tempest-GroupsTest-606302109 None] Group tempest-GroupsTest-Group-1921796765: creating Sep 03 12:00:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-af3f8a3b-f84d-437a-b166-edd55fa3df54 tempest-GroupsTest-606302109 None] Group tempest-GroupsTest-Group-1921796765: created successfully Sep 03 12:00:32 devstack sudo[97551]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-af3f8a3b-f84d-437a-b166-edd55fa3df54 tempest-GroupsTest-606302109 None] Create group completed successfully. Sep 03 12:00:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b" returned: 0 in 0.486s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:32 devstack sudo[97556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b Sep 03 12:00:32 devstack sudo[97556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:33 devstack sudo[97556]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f38a4493-1da5-49a1-aa5b-226793afa94b" returned: 0 in 0.378s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Lock "cinder-quobyte-f38a4493-1da5-49a1-aa5b-226793afa94b" released by "delete_volume" :: held 0.965s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Created reservations ['92e52315-b6ab-482c-a19e-3640f08a6196', '822a3786-bde0-4da8-8200-e819896b3673', '44b2ae45-30f0-4b7d-8f6c-b9e537857017', '994d0da6-0b35-449d-9bb6-05aada71c0dd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:33 devstack sudo[97560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:33 devstack sudo[97560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:33 devstack sudo[97560]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Deleted volume successfully. Sep 03 12:00:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-825939de-dda1-42a7-b7ad-e84c79122143 tempest-AbsoluteLimitsTests-2008986697 None] Lock "cinder-f38a4493-1da5-49a1-aa5b-226793afa94b-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Flow 'volume_create_manager' (369da83a-8197-438f-af86-a090d3f4f63d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19110a44-4eca-42bd-989a-37b6058b2f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (19110a44-4eca-42bd-989a-37b6058b2f89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372879201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3275b3ee-359d-4bf0-837c-65bd20b45196,host='devstack@QuobyteHD#QuobyteHD',id=1b00fceb-37ae-44f1-8850-1c1060eecf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0963e510904c3a8742b89e8c5a1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:35Z,use_quota=True,user_id='87b294530d7a4574913fb7edfe581af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73f894d-f763-4078-99ad-f4b23e3f03d0),volume_type_id=f73f894d-f763-4078-99ad-f4b23e3f03d0)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f7c536-c99c-4ff4-a39e-fa295c03fe74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f7c536-c99c-4ff4-a39e-fa295c03fe74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaa49c0-8216-486f-a197-9bc9a9cc3ade) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebaa49c0-8216-486f-a197-9bc9a9cc3ade) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b00fceb-37ae-44f1-8850-1c1060eecf4c', 'volume_name': 'volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7b273c-56e6-4c27-a6b6-079b890f51ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7b273c-56e6-4c27-a6b6-079b890f51ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16a9261-1059-4c60-8c06-88a64dd36563) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Volume 1b00fceb-37ae-44f1-8850-1c1060eecf4c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c', 'volume_size': 1} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3275b3ee-359d-4bf0-837c-65bd20b45196,created_at=2026-09-03T10:00:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1372879201',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3275b3ee-359d-4bf0-837c-65bd20b45196,host='devstack@QuobyteHD#QuobyteHD',id=1b00fceb-37ae-44f1-8850-1c1060eecf4c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0963e510904c3a8742b89e8c5a1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:35Z,use_quota=True,user_id='87b294530d7a4574913fb7edfe581af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73f894d-f763-4078-99ad-f4b23e3f03d0),volume_type_id=f73f894d-f763-4078-99ad-f4b23e3f03d0)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Creating volume 1b00fceb-37ae-44f1-8850-1c1060eecf4c {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:34 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:34 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c 1073741824 Sep 03 12:00:34 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:35 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c 1073741824" returned: 0 in 0.584s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:35 devstack sudo[97570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c Sep 03 12:00:35 devstack sudo[97570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:35 devstack sudo[97570]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c" returned: 0 in 0.312s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] <== create_volume: return (953ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f16a9261-1059-4c60-8c06-88a64dd36563) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7333e619-8a0e-4fa2-839c-26684f5c2e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:35 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Volume volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c (1b00fceb-37ae-44f1-8850-1c1060eecf4c): created successfully Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7333e619-8a0e-4fa2-839c-26684f5c2e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Flow 'volume_create_manager' (369da83a-8197-438f-af86-a090d3f4f63d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b4941aa2-ea5f-4394-84d0-851d1e813398 tempest-GroupsTest-606302109 None] Created volume successfully. Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Flow 'volume_create_manager' (0f3c4c19-575b-4bde-8043-a86a97607827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6219313b-0790-496f-a18b-af016406edd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6219313b-0790-496f-a18b-af016406edd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295462381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3275b3ee-359d-4bf0-837c-65bd20b45196,host='devstack@QuobyteHD#QuobyteHD',id=31a64df3-6be6-4f93-a540-13f8cda88c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0963e510904c3a8742b89e8c5a1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:38Z,use_quota=True,user_id='87b294530d7a4574913fb7edfe581af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73f894d-f763-4078-99ad-f4b23e3f03d0),volume_type_id=f73f894d-f763-4078-99ad-f4b23e3f03d0)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f900c13b-e1a2-408d-b9c1-a5ee2c3a802d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f900c13b-e1a2-408d-b9c1-a5ee2c3a802d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ddad4a-7bb8-4e3b-be02-390ee457c986) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79ddad4a-7bb8-4e3b-be02-390ee457c986) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31a64df3-6be6-4f93-a540-13f8cda88c51', 'volume_name': 'volume-31a64df3-6be6-4f93-a540-13f8cda88c51', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c702a6-d3ae-4c47-b725-fe10166e88fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (23c702a6-d3ae-4c47-b725-fe10166e88fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b541c4-6f37-486c-b7aa-974d98d3e570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:38 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Volume 31a64df3-6be6-4f93-a540-13f8cda88c51: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31a64df3-6be6-4f93-a540-13f8cda88c51', 'volume_size': 1} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3275b3ee-359d-4bf0-837c-65bd20b45196,created_at=2026-09-03T10:00:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-295462381',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3275b3ee-359d-4bf0-837c-65bd20b45196,host='devstack@QuobyteHD#QuobyteHD',id=31a64df3-6be6-4f93-a540-13f8cda88c51,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b0963e510904c3a8742b89e8c5a1240',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:38Z,use_quota=True,user_id='87b294530d7a4574913fb7edfe581af4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f73f894d-f763-4078-99ad-f4b23e3f03d0),volume_type_id=f73f894d-f763-4078-99ad-f4b23e3f03d0)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Creating volume 31a64df3-6be6-4f93-a540-13f8cda88c51 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:38 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:38 devstack sudo[97573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 1073741824 Sep 03 12:00:38 devstack sudo[97573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:38 devstack sudo[97573]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 1073741824" returned: 0 in 0.548s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:38 devstack sudo[97579]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 Sep 03 12:00:38 devstack sudo[97579]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:39 devstack sudo[97579]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51" returned: 0 in 0.295s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (01b541c4-6f37-486c-b7aa-974d98d3e570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31a64df3-6be6-4f93-a540-13f8cda88c51', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae39c62c-cd3f-4a5a-9b7c-027df920aef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:39 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Volume volume-31a64df3-6be6-4f93-a540-13f8cda88c51 (31a64df3-6be6-4f93-a540-13f8cda88c51): created successfully Sep 03 12:00:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae39c62c-cd3f-4a5a-9b7c-027df920aef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Flow 'volume_create_manager' (0f3c4c19-575b-4bde-8043-a86a97607827) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:39 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c740d8f6-549b-4826-8851-831daaee7af7 tempest-GroupsTest-606302109 None] Created volume successfully. Sep 03 12:00:40 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e01748f1-7586-47b4-a9a1-a0728ad2891d tempest-GroupsTest-606302109 None] Update group completed successfully. Sep 03 12:00:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5033c9e6-f462-4b77-8774-4eec6b2b2c45 tempest-GroupsTest-606302109 None] Update group completed successfully. Sep 03 12:00:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Acquiring lock "cinder-quobyte-1b00fceb-37ae-44f1-8850-1c1060eecf4c" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Lock "cinder-quobyte-1b00fceb-37ae-44f1-8850-1c1060eecf4c" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[045751cd-45ff-4156-b419-b61edcde0970]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:44 devstack sudo[97589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c Sep 03 12:00:44 devstack sudo[97589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:45 devstack sudo[97589]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c" returned: 0 in 0.708s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:45 devstack sudo[97594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c Sep 03 12:00:45 devstack sudo[97594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:45 devstack sudo[97594]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b00fceb-37ae-44f1-8850-1c1060eecf4c" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Lock "cinder-quobyte-1b00fceb-37ae-44f1-8850-1c1060eecf4c" released by "delete_volume" :: held 1.074s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Acquiring lock "cinder-quobyte-31a64df3-6be6-4f93-a540-13f8cda88c51" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Lock "cinder-quobyte-31a64df3-6be6-4f93-a540-13f8cda88c51" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b1e5439d-6f24-405c-8123-984e8c5b66d6]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:45 devstack sudo[97597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 Sep 03 12:00:45 devstack sudo[97597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:46 devstack sudo[97597]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51" returned: 0 in 0.743s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:46 devstack sudo[97603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51 Sep 03 12:00:46 devstack sudo[97603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Flow 'volume_create_manager' (a1f5ef67-3904-482a-bd1d-8b6365121fa0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcfceaa-f5c1-41e1-964b-947a556694a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dfcfceaa-f5c1-41e1-964b-947a556694a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1026531658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d377b4-0a6a-4197-ba98-f23d3310c656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8811364d690489d998227fc599e1c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:46Z,use_quota=True,user_id='ce3ac4776adb49dd9628d2c8ddedddea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c5473b-9369-4e2b-884c-24f29f4f2273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b1c5473b-9369-4e2b-884c-24f29f4f2273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d735641-b698-4b43-a3a0-5892b2a9d45d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9d735641-b698-4b43-a3a0-5892b2a9d45d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05d377b4-0a6a-4197-ba98-f23d3310c656', 'volume_name': 'volume-05d377b4-0a6a-4197-ba98-f23d3310c656', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e710d945-575e-433e-beeb-d6961a63d58f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e710d945-575e-433e-beeb-d6961a63d58f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101e86b-fa40-42c1-b948-bba40fe22020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Volume 05d377b4-0a6a-4197-ba98-f23d3310c656: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05d377b4-0a6a-4197-ba98-f23d3310c656', 'volume_size': 1} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-1026531658',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05d377b4-0a6a-4197-ba98-f23d3310c656,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b8811364d690489d998227fc599e1c61',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:46Z,use_quota=True,user_id='ce3ac4776adb49dd9628d2c8ddedddea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Creating volume 05d377b4-0a6a-4197-ba98-f23d3310c656 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:46 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:46 devstack sudo[97605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 1073741824 Sep 03 12:00:46 devstack sudo[97605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:46 devstack sudo[97603]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-31a64df3-6be6-4f93-a540-13f8cda88c51" returned: 0 in 0.367s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Lock "cinder-quobyte-31a64df3-6be6-4f93-a540-13f8cda88c51" released by "delete_volume" :: held 1.198s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Created reservations ['18721269-5468-48a3-8fa0-fac410d1216b'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:46 devstack cinder-volume[87256]: WARNING cinder.quota [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1881684548 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1881684548, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:00:46 devstack cinder-volume[87256]: WARNING cinder.quota [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1881684548 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1881684548, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:00:46 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Created reservations ['5b429c39-29ef-436b-9820-ff9033aa0336', '069e3db2-4500-468b-9cef-4684c77c7084', '26c17f85-ce08-4187-ae22-a0e0a3bcbef4', '712438d4-81db-4c08-a448-21e0ee2ed6d7'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Created reservations ['1e4678f8-6d8d-4dd9-9347-aeefb6379e0c', '6cc8acc4-8134-4a0b-b078-57251fb853d7', '9a9a0a73-8511-4e24-b4c1-4dc86a3d60f9', '66eeb961-4880-4858-9cc0-c5a82df1a7a4'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:47 devstack sudo[97605]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 1073741824" returned: 0 in 0.712s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:47 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 Sep 03 12:00:47 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:47 devstack sudo[97614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:47 devstack sudo[97614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:47 devstack sudo[97614]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.369s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:47 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-52e357c1-2e97-445c-9b0e-28996a138c9f tempest-GroupsTest-606302109 None] Delete group completed successfully. Sep 03 12:00:47 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656" returned: 0 in 0.562s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] <== create_volume: return (1374ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.376s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Flow 'volume_create_manager' (fc7f80ae-78b7-435e-bdde-56380439a47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cfc7f8-ce1a-499c-87b3-ce96893a7997) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5101e86b-fa40-42c1-b948-bba40fe22020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05d377b4-0a6a-4197-ba98-f23d3310c656', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503f4d28-04e6-46f5-bed4-2865d50b463a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08cfc7f8-ce1a-499c-87b3-ce96893a7997) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292694445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa79c5e-5dfa-4007-bcf9-38c6ae986ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bfd632873e4fbf8ff34bbdbded75c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:48Z,use_quota=True,user_id='a6f2719a2a6f45e8aca41b178d525cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e79372f-d245-4456-ac09-8b5b5f64f969),volume_type_id=9e79372f-d245-4456-ac09-8b5b5f64f969)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49db6f0-6f60-4953-9c1a-07c69a1ba3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c49db6f0-6f60-4953-9c1a-07c69a1ba3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4f80a9-fe3a-4aea-9d39-7a4c6a64399a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c4f80a9-fe3a-4aea-9d39-7a4c6a64399a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'faa79c5e-5dfa-4007-bcf9-38c6ae986ca8', 'volume_name': 'volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f57959f-1b1b-42a6-91a5-8feb0576f409) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4f57959f-1b1b-42a6-91a5-8feb0576f409) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aef5419-984a-42fa-93fb-7f61b5cab712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:47 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume faa79c5e-5dfa-4007-bcf9-38c6ae986ca8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8', 'volume_size': 1} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-292694445',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=faa79c5e-5dfa-4007-bcf9-38c6ae986ca8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bfd632873e4fbf8ff34bbdbded75c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:48Z,use_quota=True,user_id='a6f2719a2a6f45e8aca41b178d525cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(9e79372f-d245-4456-ac09-8b5b5f64f969),volume_type_id=9e79372f-d245-4456-ac09-8b5b5f64f969)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Creating volume faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:48 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:48 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Volume volume-05d377b4-0a6a-4197-ba98-f23d3310c656 (05d377b4-0a6a-4197-ba98-f23d3310c656): created successfully Sep 03 12:00:48 devstack sudo[97618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 1073741824 Sep 03 12:00:48 devstack sudo[97618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (503f4d28-04e6-46f5-bed4-2865d50b463a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Flow 'volume_create_manager' (a1f5ef67-3904-482a-bd1d-8b6365121fa0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e49837da-36d9-4831-bcae-79065afb5bfb tempest-VolumesMetadataTest-138963118 None] Created volume successfully. Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Flow 'volume_create_manager' (4cc63214-5bf8-4d56-84a6-6c5717cd5c17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27eb45dc-2e03-4738-9a1b-f2e7c848e92a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (27eb45dc-2e03-4738-9a1b-f2e7c848e92a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-498261245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d1ff09-7ced-4166-946b-020a982ddc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bfd632873e4fbf8ff34bbdbded75c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:48Z,use_quota=True,user_id='a6f2719a2a6f45e8aca41b178d525cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b29e9e0-e74f-4804-bf60-ba46f508214b),volume_type_id=0b29e9e0-e74f-4804-bf60-ba46f508214b)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fab8e43-1d69-4e5e-8687-6c6e41c9bd39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fab8e43-1d69-4e5e-8687-6c6e41c9bd39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80689f53-e3e1-4f00-8bfa-49a9f76aa666) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (80689f53-e3e1-4f00-8bfa-49a9f76aa666) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87d1ff09-7ced-4166-946b-020a982ddc69', 'volume_name': 'volume-87d1ff09-7ced-4166-946b-020a982ddc69', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6609308e-b409-4d8e-bef6-64c90432791d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6609308e-b409-4d8e-bef6-64c90432791d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7b4952-f921-4bff-a24a-0f23a81feb01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:48 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume 87d1ff09-7ced-4166-946b-020a982ddc69: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87d1ff09-7ced-4166-946b-020a982ddc69', 'volume_size': 1} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:48 devstack sudo[97618]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 1073741824" returned: 0 in 0.781s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:48 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 Sep 03 12:00:48 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:49 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8" returned: 0 in 0.356s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] <== create_volume: return (1229ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.237s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.609s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-498261245',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87d1ff09-7ced-4166-946b-020a982ddc69,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bfd632873e4fbf8ff34bbdbded75c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:48Z,use_quota=True,user_id='a6f2719a2a6f45e8aca41b178d525cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0b29e9e0-e74f-4804-bf60-ba46f508214b),volume_type_id=0b29e9e0-e74f-4804-bf60-ba46f508214b)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Creating volume 87d1ff09-7ced-4166-946b-020a982ddc69 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:49 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2aef5419-984a-42fa-93fb-7f61b5cab712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef62d252-febe-4abb-a06d-4134ac3e95e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 (faa79c5e-5dfa-4007-bcf9-38c6ae986ca8): created successfully Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef62d252-febe-4abb-a06d-4134ac3e95e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:49 devstack sudo[97627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 1073741824 Sep 03 12:00:49 devstack sudo[97627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Flow 'volume_create_manager' (fc7f80ae-78b7-435e-bdde-56380439a47b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:49 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0c8f8eb7-ca06-498a-8406-6d1821c6c395 tempest-TestInstancesWithCinderVolumes-672676223 None] Created volume successfully. Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Flow 'volume_create_manager' (9d711c71-2350-4f49-933b-c14061db8db6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d0b6f3-b1e0-45ad-b272-cf0242df9a59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (24d0b6f3-b1e0-45ad-b272-cf0242df9a59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1958277335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972ce9ef-6c05-4cc1-bce6-2adc88bb0850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bfd632873e4fbf8ff34bbdbded75c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:50Z,use_quota=True,user_id='a6f2719a2a6f45e8aca41b178d525cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(759bb64b-5cc1-4646-afff-12edcb0179fb),volume_type_id=759bb64b-5cc1-4646-afff-12edcb0179fb)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8515e0d3-d0e9-4760-9d15-121caaf2bfe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8515e0d3-d0e9-4760-9d15-121caaf2bfe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e0273d-f4d9-4444-a3ca-5139b89b0915) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Acquiring lock "cinder-05d377b4-0a6a-4197-ba98-f23d3310c656-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Lock "cinder-05d377b4-0a6a-4197-ba98-f23d3310c656-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Acquiring lock "cinder-quobyte-05d377b4-0a6a-4197-ba98-f23d3310c656" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:00:50 devstack sudo[97627]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 1073741824" returned: 0 in 0.802s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Lock "cinder-quobyte-05d377b4-0a6a-4197-ba98-f23d3310c656" acquired by "delete_volume" :: waited 0.033s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cbb5fcb-cd1a-4f3a-b2a4-eadb7695f635]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:50 devstack sudo[97634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 Sep 03 12:00:50 devstack sudo[97634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:50 devstack sudo[97633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 Sep 03 12:00:50 devstack sudo[97633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70e0273d-f4d9-4444-a3ca-5139b89b0915) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '972ce9ef-6c05-4cc1-bce6-2adc88bb0850', 'volume_name': 'volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850', 'volume_size': 1, 'image_id': '2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--883565751', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '90bfd632873e4fbf8ff34bbdbded75c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'created_at': datetime.datetime(2026, 9, 3, 10, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 0, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8/file', 'properties': {}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2a4f27-d2cf-4a62-ab14-0fa7648617aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7c2a4f27-d2cf-4a62-ab14-0fa7648617aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafef64d-b388-4223-8b22-96935a2dbe6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume 972ce9ef-6c05-4cc1-bce6-2adc88bb0850: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850', 'volume_size': 1, 'image_id': '2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--883565751', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '90bfd632873e4fbf8ff34bbdbded75c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'created_at': datetime.datetime(2026, 9, 3, 10, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 0, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8/file', 'properties': {}}, 'image_service': } Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Trying to clone 972ce9ef-6c05-4cc1-bce6-2adc88bb0850 from image 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 at location (None, [{'url': 'file:///opt/stack/data/glance/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:00:50 devstack sudo[97634]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69" returned: 0 in 0.445s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] <== create_volume: return (1360ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.363s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cc7b4952-f921-4bff-a24a-0f23a81feb01) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87d1ff09-7ced-4166-946b-020a982ddc69', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b760bfa-97f4-4880-ae2d-76ec5e16e33f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume volume-87d1ff09-7ced-4166-946b-020a982ddc69 (87d1ff09-7ced-4166-946b-020a982ddc69): created successfully Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b760bfa-97f4-4880-ae2d-76ec5e16e33f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Flow 'volume_create_manager' (4cc63214-5bf8-4d56-84a6-6c5717cd5c17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:50 devstack sudo[97633]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-48d43e76-bb01-4307-893f-01d48c3b84a6 tempest-TestInstancesWithCinderVolumes-672676223 None] Created volume successfully. Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656" returned: 0 in 0.629s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:50 devstack sudo[97642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656 Sep 03 12:00:50 devstack sudo[97642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:51 devstack sudo[97642]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05d377b4-0a6a-4197-ba98-f23d3310c656" returned: 0 in 0.461s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Lock "cinder-quobyte-05d377b4-0a6a-4197-ba98-f23d3310c656" released by "delete_volume" :: held 1.162s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Created reservations ['f6364c92-81ad-4aba-97f8-429fde7b55db', 'b5e2be5f-3118-459f-96db-f89341498727', 'e35d30b3-c857-4dc8-9570-e0e0d51555a3', '2df7538e-d8dc-4afe-a9e4-4efffa4848ea'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:51 devstack sudo[97646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:00:51 devstack sudo[97646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:51 devstack sudo[97646]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.478s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:00:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Deleted volume successfully. Sep 03 12:00:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-155aa2c2-e711-453d-9629-3d2ac988cfc9 tempest-VolumesMetadataTest-138963118 None] Lock "cinder-05d377b4-0a6a-4197-ba98-f23d3310c656-delete_volume" released by "delete_volume" :: held 2.033s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=186,cinder:SELECT=141,cinder:DELETE=12,cinder:INSERT=49 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Flow 'volume_create_manager' (9fd7d25c-a138-46cb-861b-84da412a946e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3c5aae-3b2e-4b53-82ad-3f680ef32ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e3c5aae-3b2e-4b53-82ad-3f680ef32ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-104482113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c008fbec-54cb-4531-b801-3e434d895a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca1dea183b347019b1d424ce8bcf7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:53Z,use_quota=True,user_id='ac2a0a881877417f9a42404e4c74648b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc83760-8e96-460b-b561-eacaddc0aa7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc83760-8e96-460b-b561-eacaddc0aa7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fcb7bc-6568-4b50-a41c-a866846328a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9fcb7bc-6568-4b50-a41c-a866846328a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c008fbec-54cb-4531-b801-3e434d895a46', 'volume_name': 'volume-c008fbec-54cb-4531-b801-3e434d895a46', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01372e3-c99e-4124-aefb-181f719d496c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a01372e3-c99e-4124-aefb-181f719d496c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6950cf-125c-4d38-b591-aa3964aae82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Volume c008fbec-54cb-4531-b801-3e434d895a46: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c008fbec-54cb-4531-b801-3e434d895a46', 'volume_size': 1} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-104482113',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c008fbec-54cb-4531-b801-3e434d895a46,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cca1dea183b347019b1d424ce8bcf7a3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:53Z,use_quota=True,user_id='ac2a0a881877417f9a42404e4c74648b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Creating volume c008fbec-54cb-4531-b801-3e434d895a46 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:53 devstack sudo[97649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 1073741824 Sep 03 12:00:53 devstack sudo[97649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:53 devstack sudo[97649]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 1073741824" returned: 0 in 0.650s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=173,cinder:SELECT=151,cinder:DELETE=12,cinder:INSERT=44 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:00:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:53 devstack sudo[97656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 Sep 03 12:00:53 devstack sudo[97656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:54 devstack sudo[97656]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6d6950cf-125c-4d38-b591-aa3964aae82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c008fbec-54cb-4531-b801-3e434d895a46', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c9b424-07f9-4ed7-af23-19fb7e3024cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:54 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Volume volume-c008fbec-54cb-4531-b801-3e434d895a46 (c008fbec-54cb-4531-b801-3e434d895a46): created successfully Sep 03 12:00:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82c9b424-07f9-4ed7-af23-19fb7e3024cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Flow 'volume_create_manager' (9fd7d25c-a138-46cb-861b-84da412a946e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-89ea8295-d19b-43ab-ac89-ac5ff7a140c4 tempest-TestImageHashVerification-1217869576 None] Created volume successfully. Sep 03 12:00:55 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD, size 20.69 MB, duration 4.64 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:00:55 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Image download 20.69 MB at 4.46 MB/s Sep 03 12:00:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[60274283-1e5e-4258-aeef-503c96b70dbe]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:55 devstack sudo[97659]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD Sep 03 12:00:55 devstack sudo[97659]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:55 devstack sudo[97659]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD" returned: 0 in 0.380s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:55 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Temporary image 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 is fetched for user a6f2719a2a6f45e8aca41b178d525cd5. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:00:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d529cff4-701c-42b4-80e9-b6d134b93217]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:55 devstack sudo[97664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD Sep 03 12:00:55 devstack sudo[97664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:56 devstack sudo[97664]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1958277335',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=972ce9ef-6c05-4cc1-bce6-2adc88bb0850,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='90bfd632873e4fbf8ff34bbdbded75c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:50Z,use_quota=True,user_id='a6f2719a2a6f45e8aca41b178d525cd5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(759bb64b-5cc1-4646-afff-12edcb0179fb),volume_type_id=759bb64b-5cc1-4646-afff-12edcb0179fb)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Creating volume 972ce9ef-6c05-4cc1-bce6-2adc88bb0850 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:00:56 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:56 devstack sudo[97669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 1073741824 Sep 03 12:00:56 devstack sudo[97669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:56 devstack sudo[97669]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 1073741824" returned: 0 in 0.518s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:56 devstack sudo[97675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 Sep 03 12:00:56 devstack sudo[97675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:56 devstack sudo[97675]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.862s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.478s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfd4b3e9-ec2a-45ed-92a5-92e2be1d985c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:56 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Attempting download of 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'metadata': {}}])) to volume 972ce9ef-6c05-4cc1-bce6-2adc88bb0850. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3c8013c-d75b-4654-95f7-ebc80ce472cb]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_o2hrsfc7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Flow 'volume_create_manager' (adea0752-9737-4a0d-9e00-f3986bae3b2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:57 devstack sudo[97678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 Sep 03 12:00:57 devstack sudo[97678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c9ea3d-a8f0-4dba-8174-38daf1e84b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14c9ea3d-a8f0-4dba-8174-38daf1e84b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-367735931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063793aa-953b-4908-9699-c58f67d44ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3834770ad744fbdb5d1b81ba916182c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:57Z,use_quota=True,user_id='48170e7981c54c269981930dbb30bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ced99d7-3e78-404a-909f-b24b77e6c149) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9ced99d7-3e78-404a-909f-b24b77e6c149) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:57 devstack sudo[97679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_o2hrsfc7 Sep 03 12:00:57 devstack sudo[97679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494d349f-b447-44e6-a632-0e258543e910) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:00:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1e7f292f-8c47-4295-a8d2-370d89630132 tempest-GroupsV314Test-1581145720 None] Group tempest-GroupsV314Test-Group-542020597: creating Sep 03 12:00:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1e7f292f-8c47-4295-a8d2-370d89630132 tempest-GroupsV314Test-1581145720 None] Group tempest-GroupsV314Test-Group-542020597: created successfully Sep 03 12:00:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1e7f292f-8c47-4295-a8d2-370d89630132 tempest-GroupsV314Test-1581145720 None] Create group completed successfully. Sep 03 12:00:57 devstack sudo[97679]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_o2hrsfc7" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_o2hrsfc7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:57 devstack sudo[97678]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46" returned: 0 in 0.478s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a5b750a-dfa3-4b14-833d-6b878a12636e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:57 devstack sudo[97687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_o2hrsfc7 Sep 03 12:00:57 devstack sudo[97687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (494d349f-b447-44e6-a632-0e258543e910) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '063793aa-953b-4908-9699-c58f67d44ce9', 'volume_name': 'volume-063793aa-953b-4908-9699-c58f67d44ce9', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9788835f-9018-4c0e-8516-1e50b449e32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9788835f-9018-4c0e-8516-1e50b449e32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c115f45-12d9-4dec-9dad-5e4a27803f5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Volume 063793aa-953b-4908-9699-c58f67d44ce9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-063793aa-953b-4908-9699-c58f67d44ce9', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Trying to clone 063793aa-953b-4908-9699-c58f67d44ce9 from image b9f83e66-733e-4378-86ef-e85be0416fc2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:00:57 devstack sudo[97688]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 Sep 03 12:00:57 devstack sudo[97688]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:57 devstack sudo[97687]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_o2hrsfc7" returned: 1 in 0.358s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_o2hrsfc7' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3410fe-1529-45d2-8f8e-a1099ff15c5f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:57 devstack sudo[97688]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46" returned: 0 in 0.470s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 /opt/stack/data/cinder/conversion/c008fbec-54cb-4531-b801-3e434d895a46.temp_image.49ed3005-ac35-4f1b-9a4a-75e965679b1742k2ahon.img {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:57 devstack sudo[97695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD Sep 03 12:00:57 devstack sudo[97695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:57 devstack sudo[97698]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 /opt/stack/data/cinder/conversion/c008fbec-54cb-4531-b801-3e434d895a46.temp_image.49ed3005-ac35-4f1b-9a4a-75e965679b1742k2ahon.img Sep 03 12:00:57 devstack sudo[97698]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:57 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:00:57 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Image download 20.69 MB at 20.69 MB/s Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[caa1c3fb-4f8b-4c48-a313-3da7fcbbb13c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:58 devstack sudo[97701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD Sep 03 12:00:58 devstack sudo[97701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:58 devstack sudo[97695]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD" returned: 0 in 0.408s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 was qcow2, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:58 devstack sudo[97710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 Sep 03 12:00:58 devstack sudo[97710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:58 devstack sudo[97701]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD" returned: 0 in 0.666s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 is fetched for user 48170e7981c54c269981930dbb30bb3c. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[47bfe5a3-5da8-4780-b2b6-75b7487ccc7f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:00:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:00:59 devstack sudo[97727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD Sep 03 12:00:59 devstack sudo[97727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Flow 'volume_create_manager' (ae2f7291-fec8-4b59-93fb-720d68d96c1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7164fe-21d3-4ef9-845c-d9c56399cb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da7164fe-21d3-4ef9-845c-d9c56399cb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472953251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3399b81-a1ef-4e98-8570-f6ec091d1aea,host='devstack@QuobyteHD#QuobyteHD',id=680a1857-d8e0-4a5b-b30f-63569706f0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b229acb5ed749e48451e4f4cdb5d083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:59Z,use_quota=True,user_id='2262a8861741405ab5771c94df0f03de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bccb95b2-f4a9-4703-af47-d8d8b256a0bb),volume_type_id=bccb95b2-f4a9-4703-af47-d8d8b256a0bb)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3e2543-04cd-4c11-8217-8929c02db8ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4f3e2543-04cd-4c11-8217-8929c02db8ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f82dab-7e6f-43c3-90c6-bbbe2ff482fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1f82dab-7e6f-43c3-90c6-bbbe2ff482fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '680a1857-d8e0-4a5b-b30f-63569706f0dc', 'volume_name': 'volume-680a1857-d8e0-4a5b-b30f-63569706f0dc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8615597-dd82-43ce-87fb-957d8a28e25c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c8615597-dd82-43ce-87fb-957d8a28e25c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d45cc99-bd6b-4dad-b764-0ef4595eb1b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:00:59 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Volume 680a1857-d8e0-4a5b-b30f-63569706f0dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-680a1857-d8e0-4a5b-b30f-63569706f0dc', 'volume_size': 1} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:00:59 devstack sudo[97727]: pam_unix(sudo:session): session closed for user root Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD" returned: 0 in 0.812s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:00:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:02 devstack sudo[97710]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850" returned: 0 in 3.958s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_2b8c650e-2cfd-4456-995b-3e4b89d63aa8_jtih1o_9devstack@QuobyteHD, size 112.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:01:02 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Converted 112.00 MB image at 28.29 MB/s Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:02 devstack sudo[97734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 1G Sep 03 12:01:02 devstack sudo[97734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:02 devstack sudo[97734]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 1G" returned: 0 in 0.781s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Downloaded image 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 ((None, [{'url': 'file:///opt/stack/data/glance/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'metadata': {}}])) to volume 972ce9ef-6c05-4cc1-bce6-2adc88bb0850 successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Temporary image 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 for user a6f2719a2a6f45e8aca41b178d525cd5 is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Marking volume 972ce9ef-6c05-4cc1-bce6-2adc88bb0850 as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:01:02 devstack sudo[97698]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Copying metadata from image 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 to 972ce9ef-6c05-4cc1-bce6-2adc88bb0850. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Creating volume glance metadata for volume 972ce9ef-6c05-4cc1-bce6-2adc88bb0850 backed by image 2b8c650e-2cfd-4456-995b-3e4b89d63aa8 with: {'image_id': '2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'image_name': 'tempest-scenario-img--883565751', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:01:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 /opt/stack/data/cinder/conversion/c008fbec-54cb-4531-b801-3e434d895a46.temp_image.49ed3005-ac35-4f1b-9a4a-75e965679b1742k2ahon.img" returned: 0 in 5.055s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[75e2705b-69bc-4f94-ba42-c11225451d1f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fafef64d-b388-4223-8b22-96935a2dbe6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850', 'volume_size': 1, 'image_id': '2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--883565751', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '90bfd632873e4fbf8ff34bbdbded75c5', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': '2b8c650e-2cfd-4456-995b-3e4b89d63aa8', 'created_at': datetime.datetime(2026, 9, 3, 10, 0, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 0, 46, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/2b8c650e-2cfd-4456-995b-3e4b89d63aa8/file', 'properties': {}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb34e3c-8c54-4145-bbad-e7f1b4dd80f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:03 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Volume volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 (972ce9ef-6c05-4cc1-bce6-2adc88bb0850): created successfully Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bbb34e3c-8c54-4145-bbad-e7f1b4dd80f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Flow 'volume_create_manager' (9d711c71-2350-4f49-933b-c14061db8db6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:01:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d87559f0-550d-47d5-9d4d-8f2ea91bca71 tempest-TestInstancesWithCinderVolumes-672676223 None] Created volume successfully. Sep 03 12:01:03 devstack sudo[97740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 Sep 03 12:01:03 devstack sudo[97740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:03 devstack sudo[97740]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46" returned: 0 in 0.538s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46, size 1024.00 MB, duration 5.06 sec, destination /opt/stack/data/cinder/conversion/c008fbec-54cb-4531-b801-3e434d895a46.temp_image.49ed3005-ac35-4f1b-9a4a-75e965679b1742k2ahon.img {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:01:03 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Converted 1024.00 MB image at 202.53 MB/s Sep 03 12:01:03 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] 49ed3005-ac35-4f1b-9a4a-75e965679b17 was raw, no need to convert to raw {{(pid=87256) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1162}} Sep 03 12:01:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-8af27e01-ac24-41a6-aa04-6719159b452c req-3f0c2488-010c-4834-bcb1-72591b30e747 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:16 devstack sudo[97761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:01:16 devstack sudo[97761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:16 devstack sudo[97761]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:01:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:01:17 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=8,cinder:DELETE=1,cinder:SELECT=13,cinder:INSERT=7 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:01:17 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=15,cinder:UPDATE=9,cinder:INSERT=5,cinder:DELETE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 26.621s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Uploaded volume to glance image-id: 49ed3005-ac35-4f1b-9a4a-75e965679b17. {{(pid=87256) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 23.842s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=a3399b81-a1ef-4e98-8570-f6ec091d1aea,created_at=2026-09-03T10:00:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-472953251',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=a3399b81-a1ef-4e98-8570-f6ec091d1aea,host='devstack@QuobyteHD#QuobyteHD',id=680a1857-d8e0-4a5b-b30f-63569706f0dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b229acb5ed749e48451e4f4cdb5d083',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:59Z,use_quota=True,user_id='2262a8861741405ab5771c94df0f03de',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bccb95b2-f4a9-4703-af47-d8d8b256a0bb),volume_type_id=bccb95b2-f4a9-4703-af47-d8d8b256a0bb)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Creating volume 680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:01:23 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:01:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:23 devstack sudo[97804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc 1073741824 Sep 03 12:01:23 devstack sudo[97804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9a85b762-cc5e-4e08-9b5a-ec948ae59dfd tempest-TestImageHashVerification-1217869576 None] Copy volume to image completed successfully. Sep 03 12:01:24 devstack sudo[97804]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc 1073741824" returned: 0 in 0.443s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:24 devstack sudo[97809]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc Sep 03 12:01:24 devstack sudo[97809]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Acquiring lock "cinder-c008fbec-54cb-4531-b801-3e434d895a46-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Lock "cinder-c008fbec-54cb-4531-b801-3e434d895a46-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Acquiring lock "cinder-quobyte-c008fbec-54cb-4531-b801-3e434d895a46" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Lock "cinder-quobyte-c008fbec-54cb-4531-b801-3e434d895a46" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[52a40b64-4e86-474a-95d4-9ef91a246cb0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:24 devstack sudo[97809]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc" returned: 0 in 0.284s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] <== create_volume: return (774ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.778s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.608s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:00:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-367735931',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=063793aa-953b-4908-9699-c58f67d44ce9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3834770ad744fbdb5d1b81ba916182c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:00:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:00:57Z,use_quota=True,user_id='48170e7981c54c269981930dbb30bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Creating volume 063793aa-953b-4908-9699-c58f67d44ce9 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:01:24 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d45cc99-bd6b-4dad-b764-0ef4595eb1b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-680a1857-d8e0-4a5b-b30f-63569706f0dc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fadc9c1-cfca-458d-9e29-27afb62ce823) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:24 devstack sudo[97813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 1073741824 Sep 03 12:01:24 devstack sudo[97813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Volume volume-680a1857-d8e0-4a5b-b30f-63569706f0dc (680a1857-d8e0-4a5b-b30f-63569706f0dc): created successfully Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1fadc9c1-cfca-458d-9e29-27afb62ce823) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Flow 'volume_create_manager' (ae2f7291-fec8-4b59-93fb-720d68d96c1c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:01:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-77fc7b92-9e5f-4b9b-b881-e8cc928ccad8 tempest-GroupsV314Test-1581145720 None] Created volume successfully. Sep 03 12:01:24 devstack sudo[97812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 Sep 03 12:01:24 devstack sudo[97812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:24 devstack sudo[97812]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46" returned: 0 in 0.406s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:24 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46 Sep 03 12:01:24 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:24 devstack sudo[97813]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 1073741824" returned: 0 in 0.465s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:24 devstack sudo[97825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 Sep 03 12:01:24 devstack sudo[97825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:24 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c008fbec-54cb-4531-b801-3e434d895a46" returned: 0 in 0.264s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Lock "cinder-quobyte-c008fbec-54cb-4531-b801-3e434d895a46" released by "delete_volume" :: held 0.718s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Created reservations ['83203224-a1c2-4827-83c4-c80efb601265', '954923c4-8d35-4af1-b249-e91f95b65193', '9f51489a-8942-43ba-b72c-cbdb6facb1af', '7fd41c5e-7d1b-4a3f-839e-736574ade4c8'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:25 devstack sudo[97825]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9" returned: 0 in 0.287s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] <== create_volume: return (799ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.803s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-8af27e01-ac24-41a6-aa04-6719159b452c req-3f0c2488-010c-4834-bcb1-72591b30e747 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 18.056s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:25 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:01:25 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-8af27e01-ac24-41a6-aa04-6719159b452c req-3f0c2488-010c-4834-bcb1-72591b30e747 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Attempting download of b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume 063793aa-953b-4908-9699-c58f67d44ce9. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-8af27e01-ac24-41a6-aa04-6719159b452c req-3f0c2488-010c-4834-bcb1-72591b30e747 tempest-TestInstancesWithCinderVolumes-672676223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'd4586f53-c88d-41d4-b956-2eeed74e04d8', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[59cd0722-d47e-4db9-9c16-57d7c932585b]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_pbhhja6m {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-8af27e01-ac24-41a6-aa04-6719159b452c req-3f0c2488-010c-4834-bcb1-72591b30e747 tempest-TestInstancesWithCinderVolumes-672676223 None] attachment_update completed successfully. Sep 03 12:01:25 devstack sudo[97831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_pbhhja6m Sep 03 12:01:25 devstack sudo[97831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:25 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.397s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:01:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Deleted volume successfully. Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-29a4c2ac-1882-4935-a1d4-bb39a2fe27e4 tempest-TestImageHashVerification-1217869576 None] Lock "cinder-c008fbec-54cb-4531-b801-3e434d895a46-delete_volume" released by "delete_volume" :: held 1.365s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:25 devstack sudo[97831]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_pbhhja6m" returned: 0 in 0.502s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_pbhhja6m {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:25 devstack sudo[97836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_pbhhja6m Sep 03 12:01:25 devstack sudo[97836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:26 devstack sudo[97836]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_pbhhja6m" returned: 1 in 0.462s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_pbhhja6m' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5bbc6be-29a4-429e-86f6-af698249f292]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:26 devstack sudo[97907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD Sep 03 12:01:26 devstack sudo[97907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:26 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Cloning volume 680a1857-d8e0-4a5b-b30f-63569706f0dc to volume 4b904de5-ad99-49df-8f96-398c93c29a53 Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Creating offline snapshot 360e3f52-228b-4eb3-a9bd-9fb95b3e98fa of volume 680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a16dda9-118b-4454-a894-66f0ab01e1e7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:26 devstack sudo[97907]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD" returned: 0 in 0.679s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] b9f83e66-733e-4378-86ef-e85be0416fc2 was qcow2, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:01:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:26 devstack sudo[98264]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 Sep 03 12:01:27 devstack sudo[98264]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:27 devstack sudo[98262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc Sep 03 12:01:27 devstack sudo[98262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:27 devstack sudo[98262]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc" returned: 0 in 0.713s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:27 devstack sudo[98297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa 1G Sep 03 12:01:27 devstack sudo[98297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:28 devstack sudo[98297]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa 1G" returned: 0 in 0.692s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-680a1857-d8e0-4a5b-b30f-63569706f0dc -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:28 devstack sudo[98308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-680a1857-d8e0-4a5b-b30f-63569706f0dc -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa Sep 03 12:01:28 devstack sudo[98308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:28 devstack sudo[98308]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-680a1857-d8e0-4a5b-b30f-63569706f0dc -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" returned: 0 in 0.660s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:28 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa is being set with open permissions: ugo+rw: NotImplementedError Sep 03 12:01:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:28 devstack sudo[98317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa Sep 03 12:01:28 devstack sudo[98317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:29 devstack sudo[98317]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" returned: 0 in 0.401s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:29 devstack sudo[98320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.info Sep 03 12:01:29 devstack sudo[98320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:29 devstack sudo[98264]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9" returned: 0 in 2.603s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:29 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_l1zme3bsdevstack@QuobyteHD, size 112.00 MB, duration 2.61 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:01:29 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Converted 112.00 MB image at 42.99 MB/s Sep 03 12:01:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:29 devstack sudo[98323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 1G Sep 03 12:01:29 devstack sudo[98323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:29 devstack sudo[98320]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.info" returned: 0 in 0.415s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:29 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.info is being set with open permissions: ugo+rw: NotImplementedError Sep 03 12:01:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:29 devstack sudo[98329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.info Sep 03 12:01:29 devstack sudo[98329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:30 devstack sudo[98323]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 1G" returned: 0 in 0.529s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Downloaded image b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume 063793aa-953b-4908-9699-c58f67d44ce9 successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 for user 48170e7981c54c269981930dbb30bb3c is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Marking volume 063793aa-953b-4908-9699-c58f67d44ce9 as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:01:30 devstack sudo[98329]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.info" returned: 0 in 0.337s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Acquiring lock "cinder-quobyte-4b904de5-ad99-49df-8f96-398c93c29a53" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-4b904de5-ad99-49df-8f96-398c93c29a53" acquired by "_copy_volume_from_snapshot" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] snapshot: 360e3f52-228b-4eb3-a9bd-9fb95b3e98fa, volume: 4b904de5-ad99-49df-8f96-398c93c29a53, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6c24c24-1922-4462-84d0-d44890d017b3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Copying metadata from image b9f83e66-733e-4378-86ef-e85be0416fc2 to 063793aa-953b-4908-9699-c58f67d44ce9. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Creating volume glance metadata for volume 063793aa-953b-4908-9699-c58f67d44ce9 backed by image b9f83e66-733e-4378-86ef-e85be0416fc2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:01:30 devstack sudo[98333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa Sep 03 12:01:30 devstack sudo[98333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c115f45-12d9-4dec-9dad-5e4a27803f5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-063793aa-953b-4908-9699-c58f67d44ce9', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d97f466-62fc-4235-a19b-aeda19daf8d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:30 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Volume volume-063793aa-953b-4908-9699-c58f67d44ce9 (063793aa-953b-4908-9699-c58f67d44ce9): created successfully Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d97f466-62fc-4235-a19b-aeda19daf8d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Flow 'volume_create_manager' (adea0752-9737-4a0d-9e00-f3986bae3b2b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:01:30 devstack sudo[98333]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" returned: 0 in 0.539s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-680a1857-d8e0-4a5b-b30f-63569706f0dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec4a5a39-fd26-4070-b3de-60899d944a58]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:31 devstack sudo[98339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc Sep 03 12:01:31 devstack sudo[98339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ccc5bdf6-c691-42ae-b6db-a0a4d35ecdd6 tempest-VolumesExtendTest-1475132012 None] Created volume successfully. Sep 03 12:01:31 devstack sudo[98339]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc" returned: 0 in 0.488s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:01:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:01:31 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:01:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:31 devstack sudo[98344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 Sep 03 12:01:31 devstack sudo[98344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:38 devstack sudo[98344]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53" returned: 0 in 7.356s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:38 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc, size 1024.00 MB, duration 7.36 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:01:38 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Converted 1024.00 MB image at 139.18 MB/s Sep 03 12:01:38 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 is being set with open permissions: ugo+rw: NotImplementedError Sep 03 12:01:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:38 devstack sudo[98362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 Sep 03 12:01:38 devstack sudo[98362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:39 devstack sudo[98362]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53" returned: 0 in 0.393s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-4b904de5-ad99-49df-8f96-398c93c29a53" released by "_copy_volume_from_snapshot" :: held 8.869s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Acquiring lock "cinder-quobyte-360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Deleting offline snapshot 360e3f52-228b-4eb3-a9bd-9fb95b3e98fa of volume 680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] snapshot_file for this snap is: volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[49ede527-b72e-47b3-850e-07f723f79b4b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:39 devstack sudo[98366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa Sep 03 12:01:39 devstack sudo[98366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:39 devstack sudo[98366]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-680a1857-d8e0-4a5b-b30f-63569706f0dc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a37c1104-35f8-4a5d-9175-a0a7683b629d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:39 devstack sudo[98376]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc Sep 03 12:01:39 devstack sudo[98376]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:40 devstack sudo[98376]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc" returned: 0 in 0.847s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:40 devstack sudo[98387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa Sep 03 12:01:40 devstack sudo[98387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=29,cinder:UPDATE=16,cinder:INSERT=11,cinder:DELETE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:01:41 devstack sudo[98387]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" returned: 0 in 0.541s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:41 devstack sudo[98392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa Sep 03 12:01:41 devstack sudo[98392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:41 devstack sudo[98392]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc.360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" returned: 0 in 0.357s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-360e3f52-228b-4eb3-a9bd-9fb95b3e98fa" released by "_delete_snapshot" :: held 2.360s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 14.845s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 9.642s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d19d00a0-9008-4dd8-96ca-436e5bbe66aa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:41 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-807a1e63-39f5-4776-8a69-4a345d4ee3b4 tempest-GroupsV314Test-1581145720 None] Create group from source-group-a3399b81-a1ef-4e98-8570-f6ec091d1aea completed successfully. Sep 03 12:01:41 devstack sudo[98396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 Sep 03 12:01:41 devstack sudo[98396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:42 devstack sudo[98396]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9" returned: 0 in 0.603s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 2G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 2G" returned: 0 in 0.139s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.816s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-edb98198-9e2a-460f-b5ea-ee73def3b99f tempest-VolumesExtendTest-1475132012 None] Extend volume completed successfully. Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Acquiring lock "cinder-quobyte-4b904de5-ad99-49df-8f96-398c93c29a53" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Acquiring lock "cinder-063793aa-953b-4908-9699-c58f67d44ce9-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-4b904de5-ad99-49df-8f96-398c93c29a53" acquired by "delete_volume" :: waited 0.071s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Lock "cinder-063793aa-953b-4908-9699-c58f67d44ce9-delete_volume" acquired by "delete_volume" :: waited 0.085s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7ea5ed5-ee52-436a-8c77-d837773d6a06]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Acquiring lock "cinder-quobyte-063793aa-953b-4908-9699-c58f67d44ce9" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-063793aa-953b-4908-9699-c58f67d44ce9" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfa2b53a-4a8e-42d4-b606-3697423662cf]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:43 devstack sudo[98406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 Sep 03 12:01:43 devstack sudo[98406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:43 devstack sudo[98407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 Sep 03 12:01:43 devstack sudo[98407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:44 devstack sudo[98406]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53" returned: 0 in 0.546s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:44 devstack sudo[98415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53 Sep 03 12:01:44 devstack sudo[98415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:44 devstack sudo[98407]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9" returned: 0 in 0.644s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:44 devstack sudo[98421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9 Sep 03 12:01:44 devstack sudo[98421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:44 devstack sudo[98421]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-063793aa-953b-4908-9699-c58f67d44ce9" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:44 devstack sudo[98415]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4b904de5-ad99-49df-8f96-398c93c29a53" returned: 0 in 0.513s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-063793aa-953b-4908-9699-c58f67d44ce9" released by "delete_volume" :: held 1.001s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-4b904de5-ad99-49df-8f96-398c93c29a53" released by "delete_volume" :: held 1.141s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Created reservations ['91dfadec-c405-4087-a5a5-61d057df432b', '8f2c77e4-ce6d-4db0-8212-9ba95089bb4a', '6683dfd3-92b4-48ed-bbc5-16498e3bb6cf', '071ab7b4-6aa3-4b70-ab02-bf5b9c412486'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Created reservations ['ce0baa29-0dd6-4036-9dd5-671359e6cba1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:45 devstack cinder-volume[87256]: WARNING cinder.quota [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1261774187 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1261774187, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:01:45 devstack cinder-volume[87256]: WARNING cinder.quota [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1261774187 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1261774187, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Created reservations ['a9da79ea-c6dc-4e23-8035-912e473e2ac2', '9b7e8090-f28a-4ca4-95ae-cad3741530bb', '2c6d591c-0b90-4822-955c-ce348a055595', '81cab0ef-cba7-48a3-80e9-56a67ba21e5c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:45 devstack sudo[98425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:01:45 devstack sudo[98425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:45 devstack sudo[98427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:01:45 devstack sudo[98427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:45 devstack sudo[98425]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.343s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:01:45 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Deleted volume successfully. Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6fc220-9565-41f3-bd30-8676df08ebfc tempest-VolumesExtendTest-1475132012 None] Lock "cinder-063793aa-953b-4908-9699-c58f67d44ce9-delete_volume" released by "delete_volume" :: held 1.959s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:45 devstack sudo[98427]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.281s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:45 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:01:45 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5eaf9472-4e28-4143-b5c1-8fa6bc4e9517 tempest-GroupsV314Test-1581145720 None] Delete group completed successfully. Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Flow 'volume_create_manager' (79b8ef6d-d8f4-4cce-a8ec-410bdf0d9d52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a46858-d6ec-45f3-a7ab-de1aa11a6f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87a46858-d6ec-45f3-a7ab-de1aa11a6f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1642079519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43edba39-a4c5-474e-9ead-713a2704b9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3834770ad744fbdb5d1b81ba916182c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:01:46Z,use_quota=True,user_id='48170e7981c54c269981930dbb30bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b68ef7-a488-4fc3-b437-ab34925b8473) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (85b68ef7-a488-4fc3-b437-ab34925b8473) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e4d474-90b0-4433-9cdb-6f7e5ca77a9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c3e4d474-90b0-4433-9cdb-6f7e5ca77a9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '43edba39-a4c5-474e-9ead-713a2704b9a4', 'volume_name': 'volume-43edba39-a4c5-474e-9ead-713a2704b9a4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dbcbf6-a6ed-44c1-8e9f-1e361377f4b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b0dbcbf6-a6ed-44c1-8e9f-1e361377f4b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989c9cc-e635-494d-bcf3-e92255fca95f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Volume 43edba39-a4c5-474e-9ead-713a2704b9a4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-43edba39-a4c5-474e-9ead-713a2704b9a4', 'volume_size': 1} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:01:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1642079519',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=43edba39-a4c5-474e-9ead-713a2704b9a4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b3834770ad744fbdb5d1b81ba916182c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:01:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:01:46Z,use_quota=True,user_id='48170e7981c54c269981930dbb30bb3c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Creating volume 43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:01:46 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:46 devstack sudo[98461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 1073741824 Sep 03 12:01:46 devstack sudo[98461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Acquiring lock "cinder-quobyte-680a1857-d8e0-4a5b-b30f-63569706f0dc" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-680a1857-d8e0-4a5b-b30f-63569706f0dc" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0eae10ec-412f-4307-88a6-ff87ffa096e0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:46 devstack sudo[98463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc Sep 03 12:01:46 devstack sudo[98463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:47 devstack sudo[98461]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 1073741824" returned: 0 in 0.669s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:47 devstack sudo[98472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 Sep 03 12:01:47 devstack sudo[98472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:47 devstack sudo[98463]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc" returned: 0 in 0.616s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:47 devstack sudo[98474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc Sep 03 12:01:47 devstack sudo[98474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:47 devstack sudo[98472]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4" returned: 0 in 0.377s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] <== create_volume: return (1116ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.119s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:47 devstack sudo[98474]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e989c9cc-e635-494d-bcf3-e92255fca95f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-43edba39-a4c5-474e-9ead-713a2704b9a4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8f8c1d-1f2f-4e99-8009-8def6946f881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-680a1857-d8e0-4a5b-b30f-63569706f0dc" returned: 0 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Lock "cinder-quobyte-680a1857-d8e0-4a5b-b30f-63569706f0dc" released by "delete_volume" :: held 1.036s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:47 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Volume volume-43edba39-a4c5-474e-9ead-713a2704b9a4 (43edba39-a4c5-474e-9ead-713a2704b9a4): created successfully Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab8f8c1d-1f2f-4e99-8009-8def6946f881) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Flow 'volume_create_manager' (79b8ef6d-d8f4-4cce-a8ec-410bdf0d9d52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:01:47 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e0045ac8-d6b8-42fa-aee8-08c743d25ddf tempest-VolumesExtendTest-1475132012 None] Created volume successfully. Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Created reservations ['c6d4197a-5fba-4aae-8e22-69f188fddd9c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:47 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Created reservations ['c6cab2f5-7529-4f97-b0d0-2342844acaec', '02126a22-cfaf-4a3b-a445-ce8d6deb90d5', '8a5b8653-2f2d-486f-9cbc-96ded6ffee6f', '75a1e278-ff77-4a77-a5de-44ceae2a2b37'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:48 devstack sudo[98488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:01:48 devstack sudo[98488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:48 devstack sudo[98488]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.315s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:01:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a54820f3-88f8-4c8d-b50b-bb54dc684b6a tempest-GroupsV314Test-1581145720 None] Delete group completed successfully. Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Creating offline snapshot 7231500c-898d-4231-a056-c28244bd3360 of volume 43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffadf684-d73a-436b-8528-1708e7897831]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:48 devstack sudo[98491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 Sep 03 12:01:48 devstack sudo[98491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:49 devstack sudo[98491]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4" returned: 0 in 0.405s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:49 devstack sudo[98496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 1G Sep 03 12:01:49 devstack sudo[98496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:49 devstack sudo[98496]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 1G" returned: 0 in 0.440s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43edba39-a4c5-474e-9ead-713a2704b9a4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:49 devstack sudo[98502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43edba39-a4c5-474e-9ead-713a2704b9a4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 Sep 03 12:01:49 devstack sudo[98502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:50 devstack sudo[98502]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-43edba39-a4c5-474e-9ead-713a2704b9a4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360" returned: 0 in 0.368s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:50 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 is being set with open permissions: ugo+rw Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:50 devstack sudo[98507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 Sep 03 12:01:50 devstack sudo[98507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:50 devstack sudo[98507]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360" returned: 0 in 0.276s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:50 devstack sudo[98510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.info Sep 03 12:01:50 devstack sudo[98510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:50 devstack sudo[98510]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.info" returned: 0 in 0.276s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:50 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.info is being set with open permissions: ugo+rw Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:50 devstack sudo[98513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.info Sep 03 12:01:50 devstack sudo[98513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:50 devstack sudo[98513]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.info" returned: 0 in 0.283s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.173s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ba7ac8ad-a9f4-4a4a-a89c-e0577f3d7f8f tempest-VolumesExtendTest-1475132012 None] Create snapshot completed successfully Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f219d1ea-6655-4101-b539-15eb4c3219fb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:52 devstack sudo[98517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 Sep 03 12:01:52 devstack sudo[98517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:52 devstack sudo[98517]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4" returned: 0 in 0.404s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 2G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 2G" returned: 0 in 0.157s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.600s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b6043bb5-9abb-428b-8abd-ad285073e26e tempest-VolumesExtendTest-1475132012 None] Extend volume completed successfully. Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Acquiring lock "cinder-7231500c-898d-4231-a056-c28244bd3360-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Lock "cinder-7231500c-898d-4231-a056-c28244bd3360-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Acquiring lock "cinder-quobyte-43edba39-a4c5-474e-9ead-713a2704b9a4" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-43edba39-a4c5-474e-9ead-713a2704b9a4" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Acquiring lock "cinder-quobyte-7231500c-898d-4231-a056-c28244bd3360" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-7231500c-898d-4231-a056-c28244bd3360" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Deleting offline snapshot 7231500c-898d-4231-a056-c28244bd3360 of volume 43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] snapshot_file for this snap is: volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[118ed1e3-f9b6-46e8-bba6-ed2fefee566a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:53 devstack sudo[98526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 Sep 03 12:01:53 devstack sudo[98526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:54 devstack sudo[98526]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360" returned: 0 in 0.418s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-43edba39-a4c5-474e-9ead-713a2704b9a4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:01:54 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8ab24c12-a3c3-4da9-9002-73b3bffdbe67]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:54 devstack sudo[98531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 Sep 03 12:01:54 devstack sudo[98531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:54 devstack sudo[98531]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4" returned: 0 in 0.428s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:54 devstack sudo[98537]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 Sep 03 12:01:54 devstack sudo[98537]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-da21bad1-b579-48cb-bc72-e1525bdda709 tempest-GroupsV320Test-1868172812 None] Group tempest-GroupsV320Test-Group-1452897120: creating Sep 03 12:01:55 devstack sudo[98537]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360" returned: 0 in 0.577s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:55 devstack sudo[98542]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360 Sep 03 12:01:55 devstack sudo[98542]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-da21bad1-b579-48cb-bc72-e1525bdda709 tempest-GroupsV320Test-1868172812 None] Group tempest-GroupsV320Test-Group-1452897120: created successfully Sep 03 12:01:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-da21bad1-b579-48cb-bc72-e1525bdda709 tempest-GroupsV320Test-1868172812 None] Create group completed successfully. Sep 03 12:01:55 devstack sudo[98542]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4.7231500c-898d-4231-a056-c28244bd3360" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-7231500c-898d-4231-a056-c28244bd3360" released by "_delete_snapshot" :: held 1.805s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-43edba39-a4c5-474e-9ead-713a2704b9a4" released by "delete_snapshot" :: held 1.835s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Created reservations ['824fa5ad-51f2-435b-81eb-7342b623f867', 'd45bc84d-366b-4c52-81cd-26dd4b8740af', '1b1f0cc2-3d9c-445e-8991-35af72766e22', 'd4611222-cd5d-4929-901a-e030fdeea720'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Delete snapshot completed successfully. Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e48d25-5b7b-448c-ad28-f8e6b51c399b tempest-VolumesExtendTest-1475132012 None] Lock "cinder-7231500c-898d-4231-a056-c28244bd3360-delete_snapshot" released by "delete_snapshot" :: held 1.980s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Acquiring lock "cinder-43edba39-a4c5-474e-9ead-713a2704b9a4-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Lock "cinder-43edba39-a4c5-474e-9ead-713a2704b9a4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Acquiring lock "cinder-quobyte-43edba39-a4c5-474e-9ead-713a2704b9a4" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-43edba39-a4c5-474e-9ead-713a2704b9a4" acquired by "delete_volume" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf9a216-73b2-41c3-b36f-0ee421a869d3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:01:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:56 devstack sudo[98545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 Sep 03 12:01:56 devstack sudo[98545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:56 devstack sudo[98545]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4" returned: 0 in 0.451s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:56 devstack sudo[98551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4 Sep 03 12:01:56 devstack sudo[98551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:56 devstack sudo[98551]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-43edba39-a4c5-474e-9ead-713a2704b9a4" returned: 0 in 0.336s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Lock "cinder-quobyte-43edba39-a4c5-474e-9ead-713a2704b9a4" released by "delete_volume" :: held 0.887s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:56 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Created reservations ['92cca3e6-77ec-497b-8cc2-6950218ea666', 'e155835d-3db2-4ab4-80ce-79c47ff64e36', '90c6fa28-7c35-4003-a13f-3470bd5dd2d6', '3dcd2e48-5fdd-4fa0-8e79-54ea8b319d33'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:56 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Created reservations ['60147258-48e9-4a38-a693-1a6fd7a0fe23'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:57 devstack sudo[98554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:01:57 devstack sudo[98554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:01:57 devstack sudo[98556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:01:57 devstack sudo[98556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:01:57 devstack sudo[98554]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.410s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:01:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Deleted volume successfully. Sep 03 12:01:57 devstack sudo[98556]: pam_unix(sudo:session): session closed for user root Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.373s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:01:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a3da2aaf-a6e7-49a3-b204-2ea1f2971d0f tempest-VolumesExtendTest-1475132012 None] Lock "cinder-43edba39-a4c5-474e-9ead-713a2704b9a4-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:01:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b4cc5ce4-4569-49b8-8c75-e7f1c2071ac4 tempest-GroupsV320Test-1868172812 None] Delete group completed successfully. Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (04435342-c0b3-4266-92a1-613f73c1309c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd807f8-0afe-4f6d-ba8c-dce0896d9da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8dd807f8-0afe-4f6d-ba8c-dce0896d9da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2009235679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a47632-b11a-47b9-bb48-ca470c823812,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:03Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b297b8fc-059d-4fa7-a35b-7e5034077f18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b297b8fc-059d-4fa7-a35b-7e5034077f18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc833a8a-8f70-48fa-a560-b168e8ff52d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc833a8a-8f70-48fa-a560-b168e8ff52d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '58a47632-b11a-47b9-bb48-ca470c823812', 'volume_name': 'volume-58a47632-b11a-47b9-bb48-ca470c823812', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7b0b58-9de8-4977-bd00-22c84946a808) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa7b0b58-9de8-4977-bd00-22c84946a808) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12097b58-44ce-412f-a028-6d66018963cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:03 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Volume 58a47632-b11a-47b9-bb48-ca470c823812: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-58a47632-b11a-47b9-bb48-ca470c823812', 'volume_size': 1} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-2009235679',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=58a47632-b11a-47b9-bb48-ca470c823812,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:03Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Creating volume 58a47632-b11a-47b9-bb48-ca470c823812 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:03 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:03 devstack sudo[98567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 1073741824 Sep 03 12:02:03 devstack sudo[98567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:04 devstack sudo[98567]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 1073741824" returned: 0 in 0.535s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:04 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 Sep 03 12:02:04 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:04 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812" returned: 0 in 0.320s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] <== create_volume: return (913ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.916s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12097b58-44ce-412f-a028-6d66018963cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-58a47632-b11a-47b9-bb48-ca470c823812', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d67dc02-3922-469c-8dce-bae0db70d6ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:04 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Volume volume-58a47632-b11a-47b9-bb48-ca470c823812 (58a47632-b11a-47b9-bb48-ca470c823812): created successfully Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d67dc02-3922-469c-8dce-bae0db70d6ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:04 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (04435342-c0b3-4266-92a1-613f73c1309c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4d525b00-04f2-4040-a1b6-a1d2b3331788 tempest-VolumesGetTest-918001057 None] Created volume successfully. Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-9a9c723d-de93-43b3-a9cb-293ca2105617 req-eaecb53e-0927-4799-a305-f8ded60fd2da tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-9a9c723d-de93-43b3-a9cb-293ca2105617 req-eaecb53e-0927-4799-a305-f8ded60fd2da tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-9a9c723d-de93-43b3-a9cb-293ca2105617 req-eaecb53e-0927-4799-a305-f8ded60fd2da tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-9a9c723d-de93-43b3-a9cb-293ca2105617 req-eaecb53e-0927-4799-a305-f8ded60fd2da tempest-TestInstancesWithCinderVolumes-672676223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9aedb310-ec1f-458d-9b0c-8c5efc61f78d', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Flow 'volume_create_manager' (3cfec966-c33d-403a-8098-59fcc6e65a67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b9c9b6-76a1-43a8-b031-a96295ceefda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (70b9c9b6-76a1-43a8-b031-a96295ceefda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-124603492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4e354b-51d8-4866-a4be-79afdae86563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487d859ccef5454ea012328105277993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:06Z,use_quota=True,user_id='ad2abf39886b4d4c8d08c1504b084b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6752b4b5-cdd9-420e-89a9-6848ca4bd041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6752b4b5-cdd9-420e-89a9-6848ca4bd041) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7628df-174e-4642-92f4-32b5dcf85423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f7628df-174e-4642-92f4-32b5dcf85423) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fd4e354b-51d8-4866-a4be-79afdae86563', 'volume_name': 'volume-fd4e354b-51d8-4866-a4be-79afdae86563', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f9b0b8-f4f5-415d-93ac-f66289bbf5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5f9b0b8-f4f5-415d-93ac-f66289bbf5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007bc67e-9270-4427-8a06-834912fc93b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:05 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Volume fd4e354b-51d8-4866-a4be-79afdae86563: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fd4e354b-51d8-4866-a4be-79afdae86563', 'volume_size': 1} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:05Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-124603492',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fd4e354b-51d8-4866-a4be-79afdae86563,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='487d859ccef5454ea012328105277993',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:06Z,use_quota=True,user_id='ad2abf39886b4d4c8d08c1504b084b17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Creating volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:05 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:05 devstack sudo[98591]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 1073741824 Sep 03 12:02:05 devstack sudo[98591]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-9a9c723d-de93-43b3-a9cb-293ca2105617 req-eaecb53e-0927-4799-a305-f8ded60fd2da tempest-TestInstancesWithCinderVolumes-672676223 None] attachment_update completed successfully. Sep 03 12:02:06 devstack sudo[98591]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 1073741824" returned: 0 in 0.607s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:06 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 Sep 03 12:02:06 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (1ee706ba-e22a-4d67-baec-5520731d93cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f481624d-a792-4b9d-8c9c-ec555fa468c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f481624d-a792-4b9d-8c9c-ec555fa468c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-466268752',display_name='tempest-VolumesGetTest-Volume-302528827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fd2354-5eab-4d80-a7ce-2c668d5a03ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:07Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a63168-ad4b-4e41-a8bd-ec8018f32770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2a63168-ad4b-4e41-a8bd-ec8018f32770) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc8e359-4a43-41b4-a354-99fbe508be28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dcc8e359-4a43-41b4-a354-99fbe508be28) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '02fd2354-5eab-4d80-a7ce-2c668d5a03ae', 'volume_name': 'volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14200258-794f-4875-98f6-b229079b7b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14200258-794f-4875-98f6-b229079b7b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1964152-7078-40dd-aede-a4cd8e8dd9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:06 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Volume 02fd2354-5eab-4d80-a7ce-2c668d5a03ae: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae', 'volume_size': 1} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:06 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563" returned: 0 in 0.364s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] <== create_volume: return (1029ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.032s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.053s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:06Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-466268752',display_name='tempest-VolumesGetTest-Volume-302528827',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=02fd2354-5eab-4d80-a7ce-2c668d5a03ae,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:07Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Creating volume 02fd2354-5eab-4d80-a7ce-2c668d5a03ae {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:06 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (007bc67e-9270-4427-8a06-834912fc93b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fd4e354b-51d8-4866-a4be-79afdae86563', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:06 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae 1073741824 Sep 03 12:02:06 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77274dc8-3785-47d3-9d89-23ba5fea5c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:06 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Volume volume-fd4e354b-51d8-4866-a4be-79afdae86563 (fd4e354b-51d8-4866-a4be-79afdae86563): created successfully Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77274dc8-3785-47d3-9d89-23ba5fea5c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Flow 'volume_create_manager' (3cfec966-c33d-403a-8098-59fcc6e65a67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-326a9e61-d8e7-4dad-a39a-a6aafa0a8954 tempest-SnapshotsActionsTest-923200332 None] Created volume successfully. Sep 03 12:02:07 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae 1073741824" returned: 0 in 0.591s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:07 devstack sudo[98608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae Sep 03 12:02:07 devstack sudo[98608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:07 devstack sudo[98608]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae" returned: 0 in 0.316s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1964152-7078-40dd-aede-a4cd8e8dd9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94ae471-c7e1-489e-95a7-7501e6e6615e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:07 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Volume volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae (02fd2354-5eab-4d80-a7ce-2c668d5a03ae): created successfully Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d94ae471-c7e1-489e-95a7-7501e6e6615e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (1ee706ba-e22a-4d67-baec-5520731d93cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6d2ed2ea-77b1-45c0-9d5b-6cb0aaa380b2 tempest-VolumesGetTest-918001057 None] Created volume successfully. Sep 03 12:02:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Creating offline snapshot f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:02:08 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0886945-bbfa-42c0-8373-304a7c820f80]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:08 devstack sudo[98617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 Sep 03 12:02:08 devstack sudo[98617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:08 devstack sudo[98617]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563" returned: 0 in 0.435s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:08 devstack sudo[98626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 1G Sep 03 12:02:08 devstack sudo[98626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-02fd2354-5eab-4d80-a7ce-2c668d5a03ae-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Lock "cinder-02fd2354-5eab-4d80-a7ce-2c668d5a03ae-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-210f6d9b-c71f-4ad5-8e09-03d422d0a6c7 req-acedeef4-4168-4ba9-b8c3-3830a8635e93 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-02fd2354-5eab-4d80-a7ce-2c668d5a03ae" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-02fd2354-5eab-4d80-a7ce-2c668d5a03ae" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:09 devstack sudo[98626]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 1G" returned: 0 in 0.595s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8dd2be-a613-4aa2-9953-904dac2955fa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:09 devstack sudo[98640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:09 devstack sudo[98640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:09 devstack sudo[98641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae Sep 03 12:02:09 devstack sudo[98641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:09 devstack sudo[98640]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.316s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:09 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 is being set with open permissions: ugo+rw Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:09 devstack sudo[98649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:09 devstack sudo[98649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:09 devstack sudo[98641]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae" returned: 0 in 0.383s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:09 devstack sudo[98652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae Sep 03 12:02:09 devstack sudo[98652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:09 devstack sudo[98649]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.303s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:09 devstack sudo[98652]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-02fd2354-5eab-4d80-a7ce-2c668d5a03ae" returned: 0 in 0.286s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-02fd2354-5eab-4d80-a7ce-2c668d5a03ae" released by "delete_volume" :: held 0.721s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:09 devstack sudo[98656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.info Sep 03 12:02:09 devstack sudo[98656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Created reservations ['154a4290-ccf7-4deb-8a4f-69d708c219c2', 'f6419e78-ec30-412c-be52-b1f34c9bb2de', '5502f1c1-74cb-440d-82e7-d592cd94a6d5', 'd24c7ed3-0397-4a42-8789-137d673fc876'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:10 devstack sudo[98658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:10 devstack sudo[98658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:10 devstack sudo[98656]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.info" returned: 0 in 0.333s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:10 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.info is being set with open permissions: ugo+rw Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:10 devstack sudo[98661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.info Sep 03 12:02:10 devstack sudo[98661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-58a47632-b11a-47b9-bb48-ca470c823812-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Lock "cinder-58a47632-b11a-47b9-bb48-ca470c823812-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-58a47632-b11a-47b9-bb48-ca470c823812" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-58a47632-b11a-47b9-bb48-ca470c823812" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:10 devstack sudo[98658]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.456s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:10 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Deleted volume successfully. Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3e0a3c-ceaa-44a4-b699-15a98b0ed905]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4950b8aa-ec40-4b9a-9446-62800e60da88 tempest-VolumesGetTest-918001057 None] Lock "cinder-02fd2354-5eab-4d80-a7ce-2c668d5a03ae-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:10 devstack sudo[98661]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.info" returned: 0 in 0.411s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.510s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-210f6d9b-c71f-4ad5-8e09-03d422d0a6c7 req-acedeef4-4168-4ba9-b8c3-3830a8635e93 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.513s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-210f6d9b-c71f-4ad5-8e09-03d422d0a6c7 req-acedeef4-4168-4ba9-b8c3-3830a8635e93 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.024s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:10 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-58b4ee89-6fb7-4d93-bcd8-5569a123c1e4 tempest-SnapshotsActionsTest-923200332 None] Create snapshot completed successfully Sep 03 12:02:10 devstack sudo[98665]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 Sep 03 12:02:10 devstack sudo[98665]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-210f6d9b-c71f-4ad5-8e09-03d422d0a6c7 req-acedeef4-4168-4ba9-b8c3-3830a8635e93 tempest-TestInstancesWithCinderVolumes-672676223 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-87d1ff09-7ced-4166-946b-020a982ddc69', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b3f46e43-52f2-49af-b72f-6219f1dd726c', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:02:10 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-210f6d9b-c71f-4ad5-8e09-03d422d0a6c7 req-acedeef4-4168-4ba9-b8c3-3830a8635e93 tempest-TestInstancesWithCinderVolumes-672676223 None] attachment_update completed successfully. Sep 03 12:02:10 devstack sudo[98665]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812" returned: 0 in 0.443s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:10 devstack sudo[98672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812 Sep 03 12:02:10 devstack sudo[98672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:11 devstack sudo[98672]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-58a47632-b11a-47b9-bb48-ca470c823812" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-58a47632-b11a-47b9-bb48-ca470c823812" released by "delete_volume" :: held 0.931s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Created reservations ['55c87ec1-eb32-4dad-84f4-4bc697db32f3', '460734fe-c087-40d8-bf7c-5d1f1602d1b0', '945d13f1-9568-4771-9fd2-ce4949a87b40', '0b8fad9f-e4c6-4030-a66b-5213ef2ba07d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:11 devstack sudo[98675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:11 devstack sudo[98675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:11 devstack sudo[98675]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.360s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:11 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Deleted volume successfully. Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-abf11629-db0b-483a-bdb8-c5c69bc3ee25 tempest-VolumesGetTest-918001057 None] Lock "cinder-58a47632-b11a-47b9-bb48-ca470c823812-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Creating offline snapshot 541c4555-b7e0-49e3-a0aa-c6a9ffac854f of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bed8048b-843b-45d4-b1e9-f28f59a8bea2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:12 devstack sudo[98680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:12 devstack sudo[98680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (16fe43d1-4ff4-4ac7-a96d-6c63683db483) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c6e5db-cb73-47ae-9de9-421d58fdf3c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8c6e5db-cb73-47ae-9de9-421d58fdf3c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1192862108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149cc689-d065-4697-a6c1-b90d6d8daa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:12Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3e214a-bded-4ae0-8204-b30972c37ccd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7c3e214a-bded-4ae0-8204-b30972c37ccd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4d837c-1ed8-41a5-a9b8-92a3c2ff5977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1b4d837c-1ed8-41a5-a9b8-92a3c2ff5977) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '149cc689-d065-4697-a6c1-b90d6d8daa0a', 'volume_name': 'volume-149cc689-d065-4697-a6c1-b90d6d8daa0a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906217ee-0cd8-4dff-9790-f57f10986299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (906217ee-0cd8-4dff-9790-f57f10986299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c36ea2-b282-4c74-a11a-f8f7fd6e0cc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:12 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Volume 149cc689-d065-4697-a6c1-b90d6d8daa0a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-149cc689-d065-4697-a6c1-b90d6d8daa0a', 'volume_size': 1} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:12 devstack sudo[98680]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.484s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:12 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f 1G Sep 03 12:02:12 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:13 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f 1G" returned: 0 in 0.539s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:13 devstack sudo[98699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f Sep 03 12:02:13 devstack sudo[98699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:13 devstack sudo[98699]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f" returned: 0 in 0.430s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:13 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f is being set with open permissions: ugo+rw Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:13 devstack sudo[98705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f Sep 03 12:02:13 devstack sudo[98705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:13 devstack sudo[98705]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f" returned: 0 in 0.287s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.857s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.555s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1192862108',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=149cc689-d065-4697-a6c1-b90d6d8daa0a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:12Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Creating volume 149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:14 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:14 devstack sudo[98708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a 1073741824 Sep 03 12:02:14 devstack sudo[98708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8e3bab18-3118-4f99-abf1-279a726cd618 tempest-SnapshotsActionsTest-923200332 None] Create snapshot completed successfully Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-541c4555-b7e0-49e3-a0aa-c6a9ffac854f-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-541c4555-b7e0-49e3-a0aa-c6a9ffac854f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-541c4555-b7e0-49e3-a0aa-c6a9ffac854f" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-541c4555-b7e0-49e3-a0aa-c6a9ffac854f" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Deleting offline snapshot 541c4555-b7e0-49e3-a0aa-c6a9ffac854f of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] snapshot_file for this snap is: volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[476d4a73-75e9-4aa8-ae41-b79efcf5cb8b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:14 devstack sudo[98708]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a 1073741824" returned: 0 in 0.612s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:14 devstack sudo[98714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f Sep 03 12:02:14 devstack sudo[98714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:14 devstack sudo[98718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a Sep 03 12:02:14 devstack sudo[98718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:14 devstack sudo[98714]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f" returned: 0 in 0.495s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:14 devstack sudo[98718]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] <== create_volume: return (1010ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.018s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d159f5ee-43f2-43b0-890a-d47afc878f19]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (11c36ea2-b282-4c74-a11a-f8f7fd6e0cc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-149cc689-d065-4697-a6c1-b90d6d8daa0a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f6fa7f-0ad9-4fd7-8137-734c08ea6c48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Volume volume-149cc689-d065-4697-a6c1-b90d6d8daa0a (149cc689-d065-4697-a6c1-b90d6d8daa0a): created successfully Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2f6fa7f-0ad9-4fd7-8137-734c08ea6c48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (16fe43d1-4ff4-4ac7-a96d-6c63683db483) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4b6c5342-9941-4790-86ef-d99c9f9c4b10 tempest-VolumesGetTest-918001057 None] Created volume successfully. Sep 03 12:02:15 devstack sudo[98732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:15 devstack sudo[98732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:15 devstack sudo[98732]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.441s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:15 devstack sudo[98747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f Sep 03 12:02:15 devstack sudo[98747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:16 devstack sudo[98747]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f" returned: 0 in 0.539s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:16 devstack sudo[98756]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f Sep 03 12:02:16 devstack sudo[98756]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (5758a5a3-51fd-4c98-8599-d756f6662553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9de52c6-1b5f-4891-b721-83a3b00959d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b9de52c6-1b5f-4891-b721-83a3b00959d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-22884190',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8e1c0d02-ab8d-4181-91e4-460d0fbca55f,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=149cc689-d065-4697-a6c1-b90d6d8daa0a,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:16Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caea4fda-b9bd-4e8f-a83b-63185ad0a42e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (caea4fda-b9bd-4e8f-a83b-63185ad0a42e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888dd1b4-a102-4e75-87eb-a1bc60254210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (888dd1b4-a102-4e75-87eb-a1bc60254210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '8e1c0d02-ab8d-4181-91e4-460d0fbca55f', 'volume_name': 'volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f', 'volume_size': 1, 'source_volid': '149cc689-d065-4697-a6c1-b90d6d8daa0a', 'source_volstatus': 'available'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1bc42c-a5ad-4539-89be-dd2b3a9c40fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4a1bc42c-a5ad-4539-89be-dd2b3a9c40fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:16 devstack sudo[98758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:16 devstack sudo[98758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18457025-dff5-44dc-85eb-d992a514b140) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:16 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Volume 8e1c0d02-ab8d-4181-91e4-460d0fbca55f: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f', 'volume_size': 1, 'source_volid': '149cc689-d065-4697-a6c1-b90d6d8daa0a', 'source_volstatus': 'available'} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:16 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Cloning volume 149cc689-d065-4697-a6c1-b90d6d8daa0a to volume 8e1c0d02-ab8d-4181-91e4-460d0fbca55f Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Creating offline snapshot 66b1c971-8e40-4d1f-8e0e-5e78259ecda7 of volume 149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2db40648-28ca-47d2-bbb5-36b5b6329bd4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:16 devstack sudo[98756]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.541c4555-b7e0-49e3-a0aa-c6a9ffac854f" returned: 0 in 0.435s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-541c4555-b7e0-49e3-a0aa-c6a9ffac854f" released by "_delete_snapshot" :: held 2.070s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" released by "delete_snapshot" :: held 2.101s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Created reservations ['df28a4a3-cada-47b9-9058-8addda705750', '0c7b0f72-ff07-4a98-8b99-bea57e3c364e', '13a152a3-20d6-48a7-81c4-fe55c07c96c3', 'bf2f45f6-95c9-41ed-8e99-a25a47324406'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:16 devstack sudo[98762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.401s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:16 devstack sudo[98758]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:16 devstack sudo[98762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:02:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Delete snapshot completed successfully. Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-12bf195b-8ab3-4c07-85c3-41ce92e880a4 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-541c4555-b7e0-49e3-a0aa-c6a9ffac854f-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-921d208d-3509-476a-a868-1b2d8fd5f691 req-b58bdb1d-d30a-4518-b632-0749e8e7db4c tempest-TestInstancesWithCinderVolumes-672676223 None] Terminate volume connection completed successfully. Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-921d208d-3509-476a-a868-1b2d8fd5f691 req-b58bdb1d-d30a-4518-b632-0749e8e7db4c tempest-TestInstancesWithCinderVolumes-672676223 None] Deleting attachment 9aedb310-ec1f-458d-9b0c-8c5efc61f78d. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:02:16 devstack sudo[98762]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a" returned: 0 in 0.517s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:16 devstack sudo[98770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 1G Sep 03 12:02:16 devstack sudo[98770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=114,cinder:INSERT=31,cinder:UPDATE=111,cinder:DELETE=8 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Flow 'volume_create_manager' (6030eeec-431c-4a97-89a8-1e5d90fd3a98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c948c9e-7dc5-41ab-8c12-cba7c45eb794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5c948c9e-7dc5-41ab-8c12-cba7c45eb794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-681992962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916a121a-7f74-48a6-a002-2d86bf7c7a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddae972b6454e25bb1737bb949f2786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:17Z,use_quota=True,user_id='df537a1447c641899c3e71e48f9bca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e3ebd-c42a-4f26-a6ed-df7d5e85ea1e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d26e3ebd-c42a-4f26-a6ed-df7d5e85ea1e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3fbc86-34e1-4be1-bd8b-832ac4578d82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc3fbc86-34e1-4be1-bd8b-832ac4578d82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '916a121a-7f74-48a6-a002-2d86bf7c7a8d', 'volume_name': 'volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45973a07-fbc3-423b-bf2b-0df6bc8a90db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45973a07-fbc3-423b-bf2b-0df6bc8a90db) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65886292-5679-45ce-b3a3-c6fbee6f60e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:17 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Volume 916a121a-7f74-48a6-a002-2d86bf7c7a8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d', 'volume_size': 1} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "cinder-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:17 devstack sudo[98770]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 1G" returned: 0 in 0.546s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-149cc689-d065-4697-a6c1-b90d6d8daa0a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "cinder-quobyte-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-quobyte-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:17 devstack sudo[98779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-149cc689-d065-4697-a6c1-b90d6d8daa0a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 Sep 03 12:02:17 devstack sudo[98779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[11105797-272e-4688-bbc2-fceb3f44a9b6]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:17 devstack sudo[98781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 Sep 03 12:02:17 devstack sudo[98781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:17 devstack sudo[98779]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-149cc689-d065-4697-a6c1-b90d6d8daa0a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7" returned: 0 in 0.484s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:17 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 is being set with open permissions: ugo+rw Sep 03 12:02:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:18 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 Sep 03 12:02:18 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:18 devstack sudo[98781]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8" returned: 0 in 0.609s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:18 devstack sudo[98791]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8 Sep 03 12:02:18 devstack sudo[98791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:18 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7" returned: 0 in 0.361s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:18 devstack sudo[98794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.info Sep 03 12:02:18 devstack sudo[98794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:18 devstack sudo[98791]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8" returned: 0 in 0.304s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-quobyte-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8" released by "delete_volume" :: held 0.984s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:18 devstack cinder-volume[87256]: WARNING cinder.quota [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2018841719-1906730269 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2018841719-1906730269, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:02:18 devstack cinder-volume[87256]: WARNING cinder.quota [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2018841719-1906730269 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2018841719-1906730269, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Created reservations ['2df750d9-199e-4f0c-9ebc-d688756fc2a2', '63a7c15c-4e5a-4339-952a-b47d2dc194d5', '125c0aec-8217-4d0d-bccb-ec7afa92ae81', 'acb6c90e-65de-4b82-9ca1-02f7ab267375'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:18 devstack sudo[98794]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.info" returned: 0 in 0.341s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:18 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.info is being set with open permissions: ugo+rw Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:18 devstack sudo[98801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:18 devstack sudo[98801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:18 devstack sudo[98802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.info Sep 03 12:02:18 devstack sudo[98802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:18 devstack sudo[98801]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Deleted volume successfully. Sep 03 12:02:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f86517e0-d419-437a-a19e-37411e993759 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-faa79c5e-5dfa-4007-bcf9-38c6ae986ca8-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:19 devstack sudo[98802]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.info" returned: 0 in 0.328s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" acquired by "_copy_volume_from_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] snapshot: 66b1c971-8e40-4d1f-8e0e-5e78259ecda7, volume: 8e1c0d02-ab8d-4181-91e4-460d0fbca55f, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[579d7d14-3d77-4a9e-81c4-59b3fdc046f8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:19 devstack sudo[98807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 Sep 03 12:02:19 devstack sudo[98807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:19 devstack sudo[98807]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7" returned: 0 in 0.431s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-149cc689-d065-4697-a6c1-b90d6d8daa0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[718cb2d5-1e5d-4c84-b20e-a92ca1794101]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:19 devstack sudo[98812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a Sep 03 12:02:19 devstack sudo[98812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:20 devstack sudo[98812]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a" returned: 0 in 0.435s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:02:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:02:20 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:02:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:20 devstack sudo[98824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f Sep 03 12:02:20 devstack sudo[98824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-b2a7c2eb-9e08-4f93-a611-88dde5b7be13 req-863d6786-651c-4933-97af-1300298b0d2b tempest-TestInstancesWithCinderVolumes-672676223 None] Terminate volume connection completed successfully. Sep 03 12:02:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-b2a7c2eb-9e08-4f93-a611-88dde5b7be13 req-863d6786-651c-4933-97af-1300298b0d2b tempest-TestInstancesWithCinderVolumes-672676223 None] Deleting attachment b3f46e43-52f2-49af-b72f-6219f1dd726c. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:02:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "cinder-87d1ff09-7ced-4166-946b-020a982ddc69-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-87d1ff09-7ced-4166-946b-020a982ddc69-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "cinder-quobyte-87d1ff09-7ced-4166-946b-020a982ddc69" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-quobyte-87d1ff09-7ced-4166-946b-020a982ddc69" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:23 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbb3148e-36c9-4ad1-a6d8-66015bda94c2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:23 devstack sudo[98908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 Sep 03 12:02:23 devstack sudo[98908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:24 devstack sudo[98908]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69" returned: 0 in 1.228s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:24 devstack sudo[98916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69 Sep 03 12:02:24 devstack sudo[98916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:25 devstack sudo[98916]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87d1ff09-7ced-4166-946b-020a982ddc69" returned: 0 in 0.713s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-quobyte-87d1ff09-7ced-4166-946b-020a982ddc69" released by "delete_volume" :: held 2.076s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:25 devstack cinder-volume[87256]: WARNING cinder.quota [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1723848841-683692850 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1723848841-683692850, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:02:25 devstack cinder-volume[87256]: WARNING cinder.quota [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1723848841-683692850 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1723848841-683692850, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Created reservations ['a1da3b14-cc0a-44f2-b7f1-fb745fed19a4', '3869bc6d-c084-456c-9361-d48fbf4642d4', 'a97de370-109b-4573-b17b-195047fe37d4', '9a2e72f9-e43d-48dc-8b00-d43fefd212b5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:25 devstack sudo[98919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:25 devstack sudo[98919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:26 devstack sudo[98919]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.724s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:26 devstack sudo[98824]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Deleted volume successfully. Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" returned: 0 in 6.517s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a, size 1024.00 MB, duration 6.52 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:02:26 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Converted 1024.00 MB image at 157.10 MB/s Sep 03 12:02:26 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f is being set with open permissions: ugo+rw Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:26 devstack sudo[98923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f Sep 03 12:02:26 devstack sudo[98923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-70990ce6-fabe-4002-b85c-038c88184aa6 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-87d1ff09-7ced-4166-946b-020a982ddc69-delete_volume" released by "delete_volume" :: held 3.412s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:26 devstack sudo[98923]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" returned: 0 in 0.332s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" released by "_copy_volume_from_snapshot" :: held 7.827s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-66b1c971-8e40-4d1f-8e0e-5e78259ecda7" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-66b1c971-8e40-4d1f-8e0e-5e78259ecda7" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Deleting offline snapshot 66b1c971-8e40-4d1f-8e0e-5e78259ecda7 of volume 149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] snapshot_file for this snap is: volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd1f6df-b487-4ed1-bba6-0900c9da05aa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:27 devstack sudo[98926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 Sep 03 12:02:27 devstack sudo[98926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:27 devstack sudo[98926]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7" returned: 0 in 0.430s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-149cc689-d065-4697-a6c1-b90d6d8daa0a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:27 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa73d5d6-c49b-4040-8096-9087d91069b8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:27 devstack sudo[98932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a Sep 03 12:02:27 devstack sudo[98932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:28 devstack sudo[98932]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a" returned: 0 in 0.633s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:28 devstack sudo[98939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 Sep 03 12:02:28 devstack sudo[98939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:28 devstack sudo[98939]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7" returned: 0 in 0.908s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:29 devstack sudo[98998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7 Sep 03 12:02:29 devstack sudo[98998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:29 devstack sudo[98998]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a.66b1c971-8e40-4d1f-8e0e-5e78259ecda7" returned: 0 in 0.514s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-66b1c971-8e40-4d1f-8e0e-5e78259ecda7" released by "_delete_snapshot" :: held 2.672s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.357s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 12.261s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-681992962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=916a121a-7f74-48a6-a002-2d86bf7c7a8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddae972b6454e25bb1737bb949f2786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:17Z,use_quota=True,user_id='df537a1447c641899c3e71e48f9bca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Creating volume 916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:29 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18457025-dff5-44dc-85eb-d992a514b140) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f', 'volume_size': 1, 'source_volid': '149cc689-d065-4697-a6c1-b90d6d8daa0a', 'source_volstatus': 'available'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:29 devstack sudo[99026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d 1073741824 Sep 03 12:02:29 devstack sudo[99026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26891e24-fd1f-475f-b4f6-bdd4f5f0513b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Volume volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f (8e1c0d02-ab8d-4181-91e4-460d0fbca55f): created successfully Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26891e24-fd1f-475f-b4f6-bdd4f5f0513b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (5758a5a3-51fd-4c98-8599-d756f6662553) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-61e7de93-48bb-432e-bc7c-8063b3f217ba tempest-VolumesGetTest-918001057 None] Created volume successfully. Sep 03 12:02:30 devstack sudo[99026]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d 1073741824" returned: 0 in 0.925s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:30 devstack sudo[99044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d Sep 03 12:02:30 devstack sudo[99044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-7cfec1cc-bca2-4931-b54f-3a5d8ba8c107 req-7f5a1f50-5829-454d-bd7d-86ac0e98f65f tempest-TestInstancesWithCinderVolumes-672676223 None] Terminate volume connection completed successfully. Sep 03 12:02:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-7cfec1cc-bca2-4931-b54f-3a5d8ba8c107 req-7f5a1f50-5829-454d-bd7d-86ac0e98f65f tempest-TestInstancesWithCinderVolumes-672676223 None] Deleting attachment d4586f53-c88d-41d4-b956-2eeed74e04d8. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:02:31 devstack sudo[99044]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d" returned: 0 in 0.532s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] <== create_volume: return (1564ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.577s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 13.158s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Creating offline snapshot 3cb67e8f-614f-4510-a7cb-f5b9158dd712 of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65886292-5679-45ce-b3a3-c6fbee6f60e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742e535f-8ec9-4125-a898-13cffa37b0e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcdf8fb-02e6-489f-a4f8-f19def44650a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:31 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Volume volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d (916a121a-7f74-48a6-a002-2d86bf7c7a8d): created successfully Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (742e535f-8ec9-4125-a898-13cffa37b0e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Flow 'volume_create_manager' (6030eeec-431c-4a97-89a8-1e5d90fd3a98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0d8a46fe-cb65-4860-b41e-9f0f6ac0fdc3 tempest-TestStampPattern-11950540 None] Created volume successfully. Sep 03 12:02:31 devstack sudo[99047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:31 devstack sudo[99047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:32 devstack sudo[99047]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.843s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:32 devstack sudo[99052]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 1G Sep 03 12:02:32 devstack sudo[99052]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (5b025d7e-ba7a-4289-b778-fbc41056d90b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aca2c9-2f9c-4323-95ff-d2ee729de4ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3aca2c9-2f9c-4323-95ff-d2ee729de4ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713958250',display_name='tempest-VolumesGetTest-Volume-53187976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c428b5-68cc-4054-8a15-4bc5ad60864b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:32Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18544817-4029-4d35-8e64-79c635610091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18544817-4029-4d35-8e64-79c635610091) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95ce053-915c-4523-b968-ce458f835a74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b95ce053-915c-4523-b968-ce458f835a74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57c428b5-68cc-4054-8a15-4bc5ad60864b', 'volume_name': 'volume-57c428b5-68cc-4054-8a15-4bc5ad60864b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4ea1e8-6357-41d8-942b-9038007b6d26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4c4ea1e8-6357-41d8-942b-9038007b6d26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5403f28-4128-461d-b475-b32f29725795) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:32 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Volume 57c428b5-68cc-4054-8a15-4bc5ad60864b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57c428b5-68cc-4054-8a15-4bc5ad60864b', 'volume_size': 1} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:32 devstack sudo[99052]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 1G" returned: 0 in 0.599s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:32 devstack sudo[99058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 Sep 03 12:02:32 devstack sudo[99058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:33 devstack sudo[99058]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712" returned: 0 in 0.404s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:33 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 is being set with open permissions: ugo+rw Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "cinder-972ce9ef-6c05-4cc1-bce6-2adc88bb0850-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:33 devstack sudo[99063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 Sep 03 12:02:33 devstack sudo[99063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-972ce9ef-6c05-4cc1-bce6-2adc88bb0850-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "cinder-quobyte-972ce9ef-6c05-4cc1-bce6-2adc88bb0850" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-quobyte-972ce9ef-6c05-4cc1-bce6-2adc88bb0850" acquired by "delete_volume" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d674ee9d-bcf5-4fbe-b7d5-4153faa30a0f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:33 devstack sudo[99066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 Sep 03 12:02:33 devstack sudo[99066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:33 devstack sudo[99063]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712" returned: 0 in 0.398s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.408s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.075s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:32Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1713958250',display_name='tempest-VolumesGetTest-Volume-53187976',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57c428b5-68cc-4054-8a15-4bc5ad60864b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:32Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Creating volume 57c428b5-68cc-4054-8a15-4bc5ad60864b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:33 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:33 devstack sudo[99069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b 1073741824 Sep 03 12:02:33 devstack sudo[99069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fcfc8ce4-6847-4cc9-ad1f-825ab7cd1b42 tempest-SnapshotsActionsTest-923200332 None] Create snapshot completed successfully Sep 03 12:02:33 devstack sudo[99066]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850" returned: 0 in 0.464s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:33 devstack sudo[99074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850 Sep 03 12:02:33 devstack sudo[99074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:34 devstack sudo[99074]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-972ce9ef-6c05-4cc1-bce6-2adc88bb0850" returned: 0 in 0.275s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-quobyte-972ce9ef-6c05-4cc1-bce6-2adc88bb0850" released by "delete_volume" :: held 0.804s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:34 devstack sudo[99069]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b 1073741824" returned: 0 in 0.542s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:34 devstack cinder-volume[87256]: WARNING cinder.quota [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139147122-2049914470 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139147122-2049914470, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:02:34 devstack cinder-volume[87256]: WARNING cinder.quota [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139147122-2049914470 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2139147122-2049914470, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Created reservations ['a50e4b70-e689-4afc-86c8-b41e2d115372', 'e1be6a5e-0466-4fa4-bc55-bee4527c7f43', '9c7ffc9e-39c1-4f0a-ae0a-39a6cb318a72', '5af6841a-add5-4e46-a257-b165fdc2d7a3'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:34 devstack sudo[99081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b Sep 03 12:02:34 devstack sudo[99081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:34 devstack sudo[99083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:34 devstack sudo[99083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:34 devstack sudo[99081]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b" returned: 0 in 0.393s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5403f28-4128-461d-b475-b32f29725795) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57c428b5-68cc-4054-8a15-4bc5ad60864b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea914c6b-db85-4e79-9181-3853e5960b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Volume volume-57c428b5-68cc-4054-8a15-4bc5ad60864b (57c428b5-68cc-4054-8a15-4bc5ad60864b): created successfully Sep 03 12:02:34 devstack sudo[99083]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea914c6b-db85-4e79-9181-3853e5960b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (5b025d7e-ba7a-4289-b778-fbc41056d90b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.428s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1273c0f5-9ca3-4e51-a687-dea3c64d4668 tempest-VolumesGetTest-918001057 None] Created volume successfully. Sep 03 12:02:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Deleted volume successfully. Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-24fa4a10-542b-4971-b9a4-cac1e240db98 tempest-TestInstancesWithCinderVolumes-672676223 None] Lock "cinder-972ce9ef-6c05-4cc1-bce6-2adc88bb0850-delete_volume" released by "delete_volume" :: held 1.555s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-3cb67e8f-614f-4510-a7cb-f5b9158dd712-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-3cb67e8f-614f-4510-a7cb-f5b9158dd712-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-3cb67e8f-614f-4510-a7cb-f5b9158dd712" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-3cb67e8f-614f-4510-a7cb-f5b9158dd712" acquired by "_delete_snapshot" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Deleting offline snapshot 3cb67e8f-614f-4510-a7cb-f5b9158dd712 of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] snapshot_file for this snap is: volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[db389e9f-3521-4b87-8d2f-1468d69a29de]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:35 devstack sudo[99087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 Sep 03 12:02:35 devstack sudo[99087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:35 devstack sudo[99087]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712" returned: 0 in 0.642s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[54d3bcc9-a9db-4fbb-b377-90de6e79f2e0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:35 devstack sudo[99094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:35 devstack sudo[99094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-57c428b5-68cc-4054-8a15-4bc5ad60864b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Lock "cinder-57c428b5-68cc-4054-8a15-4bc5ad60864b-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-57c428b5-68cc-4054-8a15-4bc5ad60864b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-57c428b5-68cc-4054-8a15-4bc5ad60864b" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[013bd5ba-7ec0-4f67-92c2-375fc83f5815]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:36 devstack sudo[99094]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.573s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:36 devstack sudo[99105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 Sep 03 12:02:36 devstack sudo[99105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:36 devstack sudo[99103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b Sep 03 12:02:36 devstack sudo[99103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:37 devstack sudo[99103]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:37 devstack sudo[99105]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b" returned: 0 in 0.813s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712" returned: 0 in 0.781s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:37 devstack sudo[99117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b Sep 03 12:02:37 devstack sudo[99117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:37 devstack sudo[99118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712 Sep 03 12:02:37 devstack sudo[99118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:37 devstack sudo[99118]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.3cb67e8f-614f-4510-a7cb-f5b9158dd712" returned: 0 in 0.451s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:37 devstack sudo[99117]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-57c428b5-68cc-4054-8a15-4bc5ad60864b" returned: 0 in 0.520s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-3cb67e8f-614f-4510-a7cb-f5b9158dd712" released by "_delete_snapshot" :: held 2.667s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" released by "delete_snapshot" :: held 2.708s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-57c428b5-68cc-4054-8a15-4bc5ad60864b" released by "delete_volume" :: held 1.421s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Created reservations ['46713484-70df-4e59-a9d0-8beb44145ae5', '3e4f1e36-49fa-4559-8742-fad1d521e716', '5b3baac2-2138-46c0-9566-4e6792707f07', 'a8d02d41-ac5d-494c-bb45-c181c830f1c1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Created reservations ['0d11ab97-ae81-4375-a3fa-61f6d90817cc', '39754a20-31b0-4289-99ea-3707ac6588de', '3d2b4f2b-9056-4422-bbfd-3f9b5eaa54f6', '47a14993-e1ab-4baf-8913-3d89d6a50799'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:37 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Delete snapshot completed successfully. Sep 03 12:02:37 devstack sudo[99123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:37 devstack sudo[99123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-431ba130-fa89-4505-9b79-379d3f94e447 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-3cb67e8f-614f-4510-a7cb-f5b9158dd712-delete_snapshot" released by "delete_snapshot" :: held 3.013s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:38 devstack sudo[99123]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.304s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:38 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Deleted volume successfully. Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79f718b6-6633-4f1b-a0bd-7838f0340c68 tempest-VolumesGetTest-918001057 None] Lock "cinder-57c428b5-68cc-4054-8a15-4bc5ad60864b-delete_volume" released by "delete_volume" :: held 2.132s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-8e1c0d02-ab8d-4181-91e4-460d0fbca55f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Lock "cinder-8e1c0d02-ab8d-4181-91e4-460d0fbca55f-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c9e6cbd-5d23-42b4-906f-90250d59c885]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Creating offline snapshot 98c21f34-8837-4851-8a73-2d8f3b0def30 of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e5830bc-f9aa-46e1-b59a-24beb7583b5b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:39 devstack sudo[99127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f Sep 03 12:02:39 devstack sudo[99127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:39 devstack sudo[99128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:39 devstack sudo[99128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:39 devstack sudo[99127]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" returned: 0 in 0.457s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:39 devstack sudo[99134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f Sep 03 12:02:39 devstack sudo[99134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:39 devstack sudo[99128]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.481s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:39 devstack sudo[99140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 1G Sep 03 12:02:39 devstack sudo[99140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:39 devstack sudo[99134]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" returned: 0 in 0.303s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-8e1c0d02-ab8d-4181-91e4-460d0fbca55f" released by "delete_volume" :: held 0.823s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Created reservations ['0e6b55bb-2cc4-48df-9521-7e4cc7f17dbf', '58b8e991-f18b-418d-8587-817267710b26', 'e6fd0e24-da55-48a6-93b3-80324eb50eb3', 'd40bf01b-488c-493f-adac-f31f66fc20f1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:39 devstack sudo[99147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:39 devstack sudo[99147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:40 devstack sudo[99140]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 1G" returned: 0 in 0.774s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:40 devstack sudo[99156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 Sep 03 12:02:40 devstack sudo[99156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:40 devstack sudo[99147]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.346s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:40 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Deleted volume successfully. Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-273926c8-c48f-4f2d-847a-8b7d37f43be4 tempest-VolumesGetTest-918001057 None] Lock "cinder-8e1c0d02-ab8d-4181-91e4-460d0fbca55f-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:40 devstack sudo[99156]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30" returned: 0 in 0.310s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:40 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 is being set with open permissions: ugo+rw Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:40 devstack sudo[99161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 Sep 03 12:02:40 devstack sudo[99161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:40 devstack sudo[99161]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30" returned: 0 in 0.248s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.945s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:40 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1b11db88-f33f-4747-ac6c-2f120fdf41e1 tempest-SnapshotsActionsTest-923200332 None] Create snapshot completed successfully Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-149cc689-d065-4697-a6c1-b90d6d8daa0a-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Lock "cinder-149cc689-d065-4697-a6c1-b90d6d8daa0a-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=167,cinder:SELECT=137,cinder:INSERT=34,cinder:DELETE=10 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-149cc689-d065-4697-a6c1-b90d6d8daa0a" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-149cc689-d065-4697-a6c1-b90d6d8daa0a" acquired by "delete_volume" :: waited 0.043s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-98c21f34-8837-4851-8a73-2d8f3b0def30-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1b92234e-5c0c-40e9-ad31-2901b396946f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-98c21f34-8837-4851-8a73-2d8f3b0def30-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-98c21f34-8837-4851-8a73-2d8f3b0def30" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-98c21f34-8837-4851-8a73-2d8f3b0def30" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Deleting offline snapshot 98c21f34-8837-4851-8a73-2d8f3b0def30 of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] snapshot_file for this snap is: volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:02:41 devstack sudo[99164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a Sep 03 12:02:41 devstack sudo[99164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b234de-2b8e-4215-8c07-a1c0482fe763]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:41 devstack sudo[99166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 Sep 03 12:02:41 devstack sudo[99166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:41 devstack sudo[99164]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a" returned: 0 in 0.481s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:41 devstack sudo[99171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a Sep 03 12:02:41 devstack sudo[99171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:42 devstack sudo[99166]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30" returned: 0 in 0.591s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8223b805-6852-424d-99de-05eeae6e4458]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:42 devstack sudo[99171]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-149cc689-d065-4697-a6c1-b90d6d8daa0a" returned: 0 in 0.367s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-149cc689-d065-4697-a6c1-b90d6d8daa0a" released by "delete_volume" :: held 1.015s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:42 devstack sudo[99178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:42 devstack sudo[99178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Created reservations ['3f09ac6d-63f4-436d-8bd1-63ec45daff32', '2b0ca0e7-aae8-4675-85bd-6e1ebbebd5cb', 'af585583-3386-4580-b808-ad0956097a6b', 'b20f33da-44c6-47c1-868d-d37890e24875'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:42 devstack sudo[99181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:42 devstack sudo[99181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:42 devstack sudo[99178]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.566s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:42 devstack sudo[99187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 Sep 03 12:02:42 devstack sudo[99187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:42 devstack sudo[99181]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.333s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Deleted volume successfully. Sep 03 12:02:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9bfded34-82ef-4151-a2ec-02538d76a14a tempest-VolumesGetTest-918001057 None] Lock "cinder-149cc689-d065-4697-a6c1-b90d6d8daa0a-delete_volume" released by "delete_volume" :: held 1.776s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:43 devstack sudo[99187]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30" returned: 0 in 0.495s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:43 devstack sudo[99224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30 Sep 03 12:02:43 devstack sudo[99224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:43 devstack sudo[99224]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.98c21f34-8837-4851-8a73-2d8f3b0def30" returned: 0 in 0.293s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-98c21f34-8837-4851-8a73-2d8f3b0def30" released by "_delete_snapshot" :: held 2.064s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" released by "delete_snapshot" :: held 2.098s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:43 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Created reservations ['c0321d38-3ce4-4c63-a6ce-ff27816fcee0', '866a3749-3595-425b-a0be-e122b189302a', '66384e5f-04f9-4980-98dd-a82d7748da62', 'f5ad3120-d1ec-4923-83d4-248e651091c5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Delete snapshot completed successfully. Sep 03 12:02:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-37740fbd-b421-4a5f-85f4-0d12ccdeb4c6 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-98c21f34-8837-4851-8a73-2d8f3b0def30-delete_snapshot" released by "delete_snapshot" :: held 2.290s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (a6d4f27a-58bb-4b48-967f-adf8480dc5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabb4bcd-b108-401c-a58e-fa35e222c1a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dabb4bcd-b108-401c-a58e-fa35e222c1a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-574126095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba7abe7-d230-40c4-bf28-90b5ac599e6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:44Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df4b73f-d8d1-4ac5-8152-db95ff0f834e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2df4b73f-d8d1-4ac5-8152-db95ff0f834e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad0e693-8ad2-41e7-98d9-34ef9b44350d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ad0e693-8ad2-41e7-98d9-34ef9b44350d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'fba7abe7-d230-40c4-bf28-90b5ac599e6d', 'volume_name': 'volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ec458b-4656-4955-abbb-aecc8e7984fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97ec458b-4656-4955-abbb-aecc8e7984fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1dc4c1-702c-4348-aaae-5ece01ec03b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:44 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Volume fba7abe7-d230-40c4-bf28-90b5ac599e6d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Trying to clone fba7abe7-d230-40c4-bf28-90b5ac599e6d from image b9f83e66-733e-4378-86ef-e85be0416fc2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Creating offline snapshot eec0338d-9a54-4934-8959-8846bfd3f23a of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f130da62-d2d0-40b5-98ae-55cb95fa4aaa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:45 devstack sudo[99229]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:45 devstack sudo[99229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:02:45 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Image download 20.69 MB at 20.69 MB/s Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6864131a-e854-4c74-a565-b97873045b9f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:45 devstack sudo[99232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD Sep 03 12:02:45 devstack sudo[99232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:45 devstack sudo[99229]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.450s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:45 devstack sudo[99237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a 1G Sep 03 12:02:45 devstack sudo[99237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:45 devstack sudo[99232]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD" returned: 0 in 0.340s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 is fetched for user 83039b1b2dea428ca727635e38aca8f4. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[974f5a5a-d639-4db8-be97-42c58b1ed7cd]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:45 devstack sudo[99246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD Sep 03 12:02:45 devstack sudo[99246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:45 devstack sudo[99237]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a 1G" returned: 0 in 0.439s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:45 devstack sudo[99248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a Sep 03 12:02:45 devstack sudo[99248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:46 devstack sudo[99246]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD" returned: 0 in 0.347s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:46 devstack sudo[99248]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:46 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a is being set with open permissions: ugo+rw Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:46 devstack sudo[99257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a Sep 03 12:02:46 devstack sudo[99257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:46 devstack sudo[99257]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a" returned: 0 in 0.318s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.640s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.471s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-574126095',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fba7abe7-d230-40c4-bf28-90b5ac599e6d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:44Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Creating volume fba7abe7-d230-40c4-bf28-90b5ac599e6d {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:46 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:46 devstack sudo[99260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d 1073741824 Sep 03 12:02:46 devstack sudo[99260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-cfb79d9a-5fcb-4a88-86d0-bb5af45505a0 tempest-SnapshotsActionsTest-923200332 None] Create snapshot completed successfully Sep 03 12:02:47 devstack sudo[99260]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d 1073741824" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:47 devstack sudo[99266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d Sep 03 12:02:47 devstack sudo[99266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-eec0338d-9a54-4934-8959-8846bfd3f23a-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-eec0338d-9a54-4934-8959-8846bfd3f23a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Acquiring lock "cinder-quobyte-eec0338d-9a54-4934-8959-8846bfd3f23a" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-eec0338d-9a54-4934-8959-8846bfd3f23a" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Deleting offline snapshot eec0338d-9a54-4934-8959-8846bfd3f23a of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] snapshot_file for this snap is: volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d36afce9-bbbe-486c-a615-942b3c7bb9f0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:47 devstack sudo[99269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a Sep 03 12:02:47 devstack sudo[99269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:47 devstack sudo[99266]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d" returned: 0 in 0.351s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.912s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Attempting download of b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume fba7abe7-d230-40c4-bf28-90b5ac599e6d. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e30532-6636-482d-bc3f-87abf2b81e5c]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_qtvw9wq1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:47 devstack sudo[99272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_qtvw9wq1 Sep 03 12:02:47 devstack sudo[99272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:47 devstack sudo[99269]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a" returned: 0 in 0.422s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3491c69-378d-4f87-bdeb-8ee24836fae0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:47 devstack sudo[99277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:47 devstack sudo[99277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:47 devstack sudo[99272]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_qtvw9wq1" returned: 0 in 0.354s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_qtvw9wq1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:48 devstack sudo[99281]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_qtvw9wq1 Sep 03 12:02:48 devstack sudo[99281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:48 devstack sudo[99277]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.425s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:48 devstack sudo[99286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a Sep 03 12:02:48 devstack sudo[99286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:48 devstack sudo[99281]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_qtvw9wq1" returned: 1 in 0.360s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_qtvw9wq1' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0342bcaa-6e9d-4993-86db-eb0fb2c13044]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:48 devstack sudo[99290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD Sep 03 12:02:48 devstack sudo[99290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:48 devstack sudo[99290]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:48 devstack sudo[99286]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] b9f83e66-733e-4378-86ef-e85be0416fc2 was qcow2, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a" returned: 0 in 0.477s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:48 devstack sudo[99299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d Sep 03 12:02:48 devstack sudo[99299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:48 devstack sudo[99300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a Sep 03 12:02:48 devstack sudo[99300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:48 devstack sudo[99300]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.eec0338d-9a54-4934-8959-8846bfd3f23a" returned: 0 in 0.267s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-eec0338d-9a54-4934-8959-8846bfd3f23a" released by "_delete_snapshot" :: held 1.713s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" released by "delete_snapshot" :: held 1.753s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:49 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Created reservations ['0c83f68f-3829-40f4-8756-2d14d740fc0f', 'e9c1d509-f32f-4794-905a-ac36968c87bf', 'a192007e-7e5c-42bb-825e-14767b8ed682', '6e941181-15b2-4f4a-81b1-9d5055bec3da'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:49 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Delete snapshot completed successfully. Sep 03 12:02:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-171930a2-a735-4681-81a6-f14e08da7e19 tempest-SnapshotsActionsTest-1821379462 None] Lock "cinder-eec0338d-9a54-4934-8959-8846bfd3f23a-delete_snapshot" released by "delete_snapshot" :: held 1.947s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "cinder-f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "cinder-quobyte-f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-quobyte-f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Deleting offline snapshot f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 of volume fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] snapshot_file for this snap is: volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d9d4f8f7-14ba-4851-847b-a611ab03e3bc]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:50 devstack sudo[99318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:50 devstack sudo[99318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:50 devstack sudo[99318]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.464s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fd4e354b-51d8-4866-a4be-79afdae86563(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b55ab779-0483-47d8-b0ba-bde8a030f71f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:50 devstack sudo[99324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 Sep 03 12:02:50 devstack sudo[99324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:50 devstack sudo[99299]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d" returned: 0 in 2.304s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_avtqcchudevstack@QuobyteHD, size 112.00 MB, duration 2.31 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:02:50 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Converted 112.00 MB image at 48.55 MB/s Sep 03 12:02:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:51 devstack sudo[99326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d 1G Sep 03 12:02:51 devstack sudo[99326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:51 devstack sudo[99324]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563" returned: 0 in 0.548s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:51 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:51 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:51 devstack sudo[99326]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d 1G" returned: 0 in 0.385s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Downloaded image b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume fba7abe7-d230-40c4-bf28-90b5ac599e6d successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 for user 83039b1b2dea428ca727635e38aca8f4 is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Marking volume fba7abe7-d230-40c4-bf28-90b5ac599e6d as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Copying metadata from image b9f83e66-733e-4378-86ef-e85be0416fc2 to fba7abe7-d230-40c4-bf28-90b5ac599e6d. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Creating volume glance metadata for volume fba7abe7-d230-40c4-bf28-90b5ac599e6d backed by image b9f83e66-733e-4378-86ef-e85be0416fc2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c1dc4c1-702c-4348-aaae-5ece01ec03b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962fc777-145b-47c9-b54e-96b987d1b68e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Volume volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d (fba7abe7-d230-40c4-bf28-90b5ac599e6d): created successfully Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (962fc777-145b-47c9-b54e-96b987d1b68e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (a6d4f27a-58bb-4b48-967f-adf8480dc5d9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0a05f27f-15d0-4035-8436-41b551587012 tempest-VolumesGetTest-918001057 None] Created volume successfully. Sep 03 12:02:51 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.473s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:51 devstack sudo[99341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3 Sep 03 12:02:51 devstack sudo[99341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:51 devstack sudo[99341]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563.f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-quobyte-f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3" released by "_delete_snapshot" :: held 1.974s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" released by "delete_snapshot" :: held 2.011s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Created reservations ['9fee85f4-89ee-4740-aadc-8bc6b973b282', '4c47dd59-a937-4244-a5c2-62a299e8a662', 'fdd8d809-a608-4bb0-b23e-9ddca498cc9c', 'c31b99e4-09ff-4259-819e-ce7dad0187a0'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Delete snapshot completed successfully. Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-158c9e55-a973-438b-933f-606bbbfe119c tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-f9e2e68a-957a-4f1c-b3f2-03ea187ed4e3-delete_snapshot" released by "delete_snapshot" :: held 2.279s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (8312e11a-6d4e-46b4-954d-6017cafa51f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ada7448-8a47-4a17-8d4e-4008e71eb13f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ada7448-8a47-4a17-8d4e-4008e71eb13f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-809951016',display_name='tempest-VolumesGetTest-Volume-1883292469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3edda6c1-e8da-40e6-a21d-6eb9f248722f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:53Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8224d9a-6cfe-4560-b3d6-68f87590a32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a8224d9a-6cfe-4560-b3d6-68f87590a32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781b0533-98b7-40a8-92b4-f6ac8d9cdafd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (781b0533-98b7-40a8-92b4-f6ac8d9cdafd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3edda6c1-e8da-40e6-a21d-6eb9f248722f', 'volume_name': 'volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7452b5c-b503-469f-b170-768f6618b3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d7452b5c-b503-469f-b170-768f6618b3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32a802a-f99d-475e-a43b-6b022bc42f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Volume 3edda6c1-e8da-40e6-a21d-6eb9f248722f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f', 'volume_size': 1} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:02:53Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-809951016',display_name='tempest-VolumesGetTest-Volume-1883292469',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3edda6c1-e8da-40e6-a21d-6eb9f248722f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3b7057604453441d887bbc59a8c04919',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:02:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:02:53Z,use_quota=True,user_id='83039b1b2dea428ca727635e38aca8f4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Creating volume 3edda6c1-e8da-40e6-a21d-6eb9f248722f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:02:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:53 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f 1073741824 Sep 03 12:02:53 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "cinder-fd4e354b-51d8-4866-a4be-79afdae86563-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-fd4e354b-51d8-4866-a4be-79afdae86563-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13c6d9f-3f42-4736-97bf-430c47597e95]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:53 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f 1073741824" returned: 0 in 0.555s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:53 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 Sep 03 12:02:53 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:53 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f Sep 03 12:02:53 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:53 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] <== create_volume: return (879ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f32a802a-f99d-475e-a43b-6b022bc42f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48c8985-a8fd-48aa-9a0b-3e32dc8bd590) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:02:53 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563" returned: 0 in 0.429s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Volume volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f (3edda6c1-e8da-40e6-a21d-6eb9f248722f): created successfully Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e48c8985-a8fd-48aa-9a0b-3e32dc8bd590) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:02:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Flow 'volume_create_manager' (8312e11a-6d4e-46b4-954d-6017cafa51f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:02:53 devstack sudo[99360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563 Sep 03 12:02:53 devstack sudo[99360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:53 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-df65a550-8d0b-43cb-88c7-2e0153e251f9 tempest-VolumesGetTest-918001057 None] Created volume successfully. Sep 03 12:02:54 devstack sudo[99360]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fd4e354b-51d8-4866-a4be-79afdae86563" returned: 0 in 0.281s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-quobyte-fd4e354b-51d8-4866-a4be-79afdae86563" released by "delete_volume" :: held 0.781s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Created reservations ['adc014e1-9d25-4310-bf79-b867566b4fe8', 'b755adb0-9beb-45f3-935a-a7d6e4d1e5d4', '623f12a4-c6ba-45b1-8a03-931b93c7161c', 'e8b6bbe7-4c99-4914-bbc4-ebce966e733a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:54 devstack sudo[99363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:54 devstack sudo[99363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:54 devstack sudo[99363]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.272s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Deleted volume successfully. Sep 03 12:02:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9dd89211-b01f-4c26-9192-e849ee35c14d tempest-SnapshotsActionsTest-923200332 None] Lock "cinder-fd4e354b-51d8-4866-a4be-79afdae86563-delete_volume" released by "delete_volume" :: held 1.277s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-3edda6c1-e8da-40e6-a21d-6eb9f248722f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Lock "cinder-3edda6c1-e8da-40e6-a21d-6eb9f248722f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-3edda6c1-e8da-40e6-a21d-6eb9f248722f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-3edda6c1-e8da-40e6-a21d-6eb9f248722f" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c56076cd-5b2b-4453-8b1e-de8c7ac1270d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:55 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f Sep 03 12:02:55 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:55 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f" returned: 0 in 0.515s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:55 devstack sudo[99375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f Sep 03 12:02:55 devstack sudo[99375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:56 devstack sudo[99375]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3edda6c1-e8da-40e6-a21d-6eb9f248722f" returned: 0 in 0.394s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-3edda6c1-e8da-40e6-a21d-6eb9f248722f" released by "delete_volume" :: held 0.971s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Created reservations ['52a7f673-b39f-4145-975e-bedf7be6a939', 'a50f7c8c-13ac-4b08-8aae-bffd564daeff', '65b8e5f5-12ed-4abe-ae13-06296c6cc738', 'b731df4e-9885-4278-83db-fe1f2b542dfb'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:56 devstack sudo[99381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:56 devstack sudo[99381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:56 devstack sudo[99381]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.345s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:56 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Deleted volume successfully. Sep 03 12:02:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-777709bf-f8d4-425f-95cf-7c99cad1e5fd tempest-VolumesGetTest-918001057 None] Lock "cinder-3edda6c1-e8da-40e6-a21d-6eb9f248722f-delete_volume" released by "delete_volume" :: held 1.663s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-68899bed-9fb9-4a02-b212-4f7a68f981ed req-69230381-be21-4b26-af54-14df7a9dc63d tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-68899bed-9fb9-4a02-b212-4f7a68f981ed req-69230381-be21-4b26-af54-14df7a9dc63d tempest-TestStampPattern-11950540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-68899bed-9fb9-4a02-b212-4f7a68f981ed req-69230381-be21-4b26-af54-14df7a9dc63d tempest-TestStampPattern-11950540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-68899bed-9fb9-4a02-b212-4f7a68f981ed req-69230381-be21-4b26-af54-14df7a9dc63d tempest-TestStampPattern-11950540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '19fadbf8-950d-44eb-8d9a-301a69858307', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:02:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-68899bed-9fb9-4a02-b212-4f7a68f981ed req-69230381-be21-4b26-af54-14df7a9dc63d tempest-TestStampPattern-11950540 None] attachment_update completed successfully. Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-fba7abe7-d230-40c4-bf28-90b5ac599e6d-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Lock "cinder-fba7abe7-d230-40c4-bf28-90b5ac599e6d-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Acquiring lock "cinder-quobyte-fba7abe7-d230-40c4-bf28-90b5ac599e6d" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-fba7abe7-d230-40c4-bf28-90b5ac599e6d" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ada8895-9244-4cf1-8ed3-af9ae24597b0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:02:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:57 devstack sudo[99773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d Sep 03 12:02:57 devstack sudo[99773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:58 devstack sudo[99773]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d" returned: 0 in 0.534s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:58 devstack sudo[99779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d Sep 03 12:02:58 devstack sudo[99779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:58 devstack sudo[99779]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fba7abe7-d230-40c4-bf28-90b5ac599e6d" returned: 0 in 0.311s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Lock "cinder-quobyte-fba7abe7-d230-40c4-bf28-90b5ac599e6d" released by "delete_volume" :: held 0.920s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Created reservations ['29fb286a-8f00-41fd-b1bd-281bba637bf8', '31f53cc2-7ce0-4427-8ead-ff1000a87806', 'e85e0d58-61f4-4e2a-a806-686ae5197246', 'e1f6428a-6c52-4d0e-95db-5384ab6ba64d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:02:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:02:58 devstack sudo[99782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:02:58 devstack sudo[99782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:02:59 devstack sudo[99782]: pam_unix(sudo:session): session closed for user root Sep 03 12:02:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.344s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:02:59 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:02:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Deleted volume successfully. Sep 03 12:02:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7812c911-72dc-4ed2-837e-8f2e9efb8a51 tempest-VolumesGetTest-918001057 None] Lock "cinder-fba7abe7-d230-40c4-bf28-90b5ac599e6d-delete_volume" released by "delete_volume" :: held 1.650s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-de87030e-68fc-42bd-b683-01d3d0b1e4f5 req-43e5ba92-580c-42bd-888b-ca1097beec2c tempest-TestStampPattern-11950540 None] Terminate volume connection completed successfully. Sep 03 12:03:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-de87030e-68fc-42bd-b683-01d3d0b1e4f5 req-43e5ba92-580c-42bd-888b-ca1097beec2c tempest-TestStampPattern-11950540 None] Deleting attachment 19fadbf8-950d-44eb-8d9a-301a69858307. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:03:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Creating offline snapshot b432f668-e12d-4a02-b798-228b88136f41 of volume 916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:03:04 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ae60626-a989-460a-ab68-47f94e86d575]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:04 devstack sudo[99835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d Sep 03 12:03:04 devstack sudo[99835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:05 devstack sudo[99835]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d" returned: 0 in 0.560s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:05 devstack sudo[99840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 1G Sep 03 12:03:05 devstack sudo[99840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:05 devstack sudo[99840]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 1G" returned: 0 in 0.501s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:05 devstack sudo[99846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 Sep 03 12:03:05 devstack sudo[99846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:06 devstack sudo[99846]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41" returned: 0 in 0.374s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:06 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 is being set with open permissions: ugo+rw Sep 03 12:03:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:06 devstack sudo[99851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 Sep 03 12:03:06 devstack sudo[99851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:06 devstack sudo[99851]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41" returned: 0 in 0.323s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:06 devstack sudo[99854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.info Sep 03 12:03:06 devstack sudo[99854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:06 devstack sudo[99854]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.info" returned: 0 in 0.385s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:06 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.info is being set with open permissions: ugo+rw Sep 03 12:03:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:06 devstack sudo[99857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.info Sep 03 12:03:06 devstack sudo[99857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Flow 'volume_create_manager' (2feb763c-94e3-4ff7-a464-2ee4516fc10b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c65e4b-6094-4867-8c76-4562de50f174) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78c65e4b-6094-4867-8c76-4562de50f174) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1377479218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd8edcb-291d-4230-a415-64fcaf75bd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fe63a26341407ea589fbe12e435c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:07Z,use_quota=True,user_id='91230174c87841a89d34529902ddf2f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e411c6-c84e-4ce7-bcd2-e4b3b98939a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (80e411c6-c84e-4ce7-bcd2-e4b3b98939a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67650275-2a48-44f5-ba83-5a69a982b66f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67650275-2a48-44f5-ba83-5a69a982b66f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7dd8edcb-291d-4230-a415-64fcaf75bd38', 'volume_name': 'volume-7dd8edcb-291d-4230-a415-64fcaf75bd38', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ee729e-5bf5-48dc-9d9a-45a449a4af5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (71ee729e-5bf5-48dc-9d9a-45a449a4af5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7320ff-f50d-47d5-be80-97398937d782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:07 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Volume 7dd8edcb-291d-4230-a415-64fcaf75bd38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7dd8edcb-291d-4230-a415-64fcaf75bd38', 'volume_size': 1} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:07 devstack sudo[99857]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.info" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.568s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.062s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1377479218',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dd8edcb-291d-4230-a415-64fcaf75bd38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='84fe63a26341407ea589fbe12e435c75',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:07Z,use_quota=True,user_id='91230174c87841a89d34529902ddf2f3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Creating volume 7dd8edcb-291d-4230-a415-64fcaf75bd38 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:03:07 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:07 devstack sudo[99860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 1073741824 Sep 03 12:03:07 devstack sudo[99860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4c210fe6-58e8-4313-9473-449edac4098c tempest-TestStampPattern-11950540 None] Create snapshot completed successfully Sep 03 12:03:07 devstack sudo[99860]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 1073741824" returned: 0 in 0.530s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:07 devstack sudo[99866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 Sep 03 12:03:07 devstack sudo[99866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:08 devstack sudo[99866]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38" returned: 0 in 0.364s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:03:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.961s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb7320ff-f50d-47d5-be80-97398937d782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dd8edcb-291d-4230-a415-64fcaf75bd38', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fe3216-46f4-4ab7-b6e3-e9f9b2dfb3ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:08 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Volume volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 (7dd8edcb-291d-4230-a415-64fcaf75bd38): created successfully Sep 03 12:03:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9fe3216-46f4-4ab7-b6e3-e9f9b2dfb3ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Flow 'volume_create_manager' (2feb763c-94e3-4ff7-a464-2ee4516fc10b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d20edcf6-a7d3-44c1-b6f8-ddc3edc73da4 tempest-VolumesNegativeTest-1083768885 None] Created volume successfully. Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Flow 'volume_create_manager' (5f843d5a-3821-46ef-98ab-402727c3f4a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5da778e-3e80-42f2-b487-542b22ed1a26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5da778e-3e80-42f2-b487-542b22ed1a26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706435371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d835ea-56bf-48a7-911c-530c0059a862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c0d8a43f2448af96d7ae8d74f9ae56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:16Z,use_quota=True,user_id='09efbb91fd424db6a208af39b343de47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bddf6a3-bd13-4d57-b75b-5de981ea9036) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bddf6a3-bd13-4d57-b75b-5de981ea9036) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ff29e6-44eb-46e8-9751-207d54f8ebfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73ff29e6-44eb-46e8-9751-207d54f8ebfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d835ea-56bf-48a7-911c-530c0059a862', 'volume_name': 'volume-c8d835ea-56bf-48a7-911c-530c0059a862', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe82964b-d16d-49c7-b0b8-ca3b395b4155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe82964b-d16d-49c7-b0b8-ca3b395b4155) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7b04ce-090d-4a14-88bc-604d0f1fccab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Volume c8d835ea-56bf-48a7-911c-530c0059a862: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d835ea-56bf-48a7-911c-530c0059a862', 'volume_size': 1} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-706435371',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d835ea-56bf-48a7-911c-530c0059a862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c0d8a43f2448af96d7ae8d74f9ae56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:16Z,use_quota=True,user_id='09efbb91fd424db6a208af39b343de47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Creating volume c8d835ea-56bf-48a7-911c-530c0059a862 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:03:15 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:03:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:15 devstack sudo[99917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 1073741824 Sep 03 12:03:15 devstack sudo[99917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:16 devstack sudo[99922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:03:16 devstack sudo[99922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:16 devstack sudo[99917]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 1073741824" returned: 0 in 0.649s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:16 devstack sudo[99926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 Sep 03 12:03:16 devstack sudo[99926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:16 devstack sudo[99922]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.435s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:03:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:03:17 devstack sudo[99926]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862" returned: 0 in 0.588s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] <== create_volume: return (1313ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:03:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.316s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3c7b04ce-090d-4a14-88bc-604d0f1fccab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d835ea-56bf-48a7-911c-530c0059a862', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82957641-6430-4558-aa8c-3cd397f81977) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:17 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Volume volume-c8d835ea-56bf-48a7-911c-530c0059a862 (c8d835ea-56bf-48a7-911c-530c0059a862): created successfully Sep 03 12:03:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (82957641-6430-4558-aa8c-3cd397f81977) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Flow 'volume_create_manager' (5f843d5a-3821-46ef-98ab-402727c3f4a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:17 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e1fd55e6-3651-4bb1-bf24-b034457272ef tempest-VolumeQuotasAdminTestJSON-203028630 None] Created volume successfully. Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=111,cinder:UPDATE=115,cinder:INSERT=40,cinder:DELETE=11 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Flow 'volume_create_manager' (bfd2ff69-fc1a-42e7-8401-4d1ac7fe1edd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ed5737-1420-43a7-adcd-9864e89ac466) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Acquiring lock "cinder-c8d835ea-56bf-48a7-911c-530c0059a862-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (09ed5737-1420-43a7-adcd-9864e89ac466) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1187266308',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=742ba8df-458a-4432-bd29-fb317e6d42b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2ddae972b6454e25bb1737bb949f2786',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=b432f668-e12d-4a02-b798-228b88136f41,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:18Z,use_quota=True,user_id='df537a1447c641899c3e71e48f9bca9c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f473c65-7d67-4047-bd76-cb3e4183558f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f473c65-7d67-4047-bd76-cb3e4183558f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a2f2b6-c3e1-46c9-9f3d-1dde1676ea3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46a2f2b6-c3e1-46c9-9f3d-1dde1676ea3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '742ba8df-458a-4432-bd29-fb317e6d42b1', 'volume_name': 'volume-742ba8df-458a-4432-bd29-fb317e6d42b1', 'volume_size': 1, 'snapshot_id': 'b432f668-e12d-4a02-b798-228b88136f41'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13405df-c28e-4a9b-9a98-cabac9405282) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c13405df-c28e-4a9b-9a98-cabac9405282) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b359e7-5751-4ffd-990b-f8a08f2af810) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Volume 742ba8df-458a-4432-bd29-fb317e6d42b1: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-742ba8df-458a-4432-bd29-fb317e6d42b1', 'volume_size': 1, 'snapshot_id': 'b432f668-e12d-4a02-b798-228b88136f41'} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "cinder-c8d835ea-56bf-48a7-911c-530c0059a862-delete_volume" acquired by "delete_volume" :: waited 0.216s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-quobyte-b432f668-e12d-4a02-b798-228b88136f41-742ba8df-458a-4432-bd29-fb317e6d42b1" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-b432f668-e12d-4a02-b798-228b88136f41-742ba8df-458a-4432-bd29-fb317e6d42b1" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Creating volume 742ba8df-458a-4432-bd29-fb317e6d42b1 from snapshot b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-quobyte-742ba8df-458a-4432-bd29-fb317e6d42b1" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-742ba8df-458a-4432-bd29-fb317e6d42b1" acquired by "_copy_volume_from_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] snapshot: b432f668-e12d-4a02-b798-228b88136f41, volume: 742ba8df-458a-4432-bd29-fb317e6d42b1, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Acquiring lock "cinder-quobyte-c8d835ea-56bf-48a7-911c-530c0059a862" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "cinder-quobyte-c8d835ea-56bf-48a7-911c-530c0059a862" acquired by "delete_volume" :: waited 0.095s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[acfa408f-9893-40e9-8eaf-ceab0d84c10b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[21653cbc-f9f0-43e1-bd1f-4abd4c4390bb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:18 devstack sudo[99995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 Sep 03 12:03:18 devstack sudo[99995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:18 devstack sudo[99994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 Sep 03 12:03:18 devstack sudo[99994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:19 devstack sudo[99995]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862" returned: 0 in 0.965s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:19 devstack sudo[99994]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41" returned: 0 in 1.034s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:03:19 devstack sudo[100007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862 Sep 03 12:03:19 devstack sudo[100007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e43a27d7-a51d-4659-8235-7404e26b3d07]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:19 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d Sep 03 12:03:19 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:20 devstack sudo[100007]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c8d835ea-56bf-48a7-911c-530c0059a862" returned: 0 in 0.656s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "cinder-quobyte-c8d835ea-56bf-48a7-911c-530c0059a862" released by "delete_volume" :: held 1.704s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Created reservations ['fc65f247-4aea-4282-9338-9e74c895e20c', '9891d4bb-839c-4c56-b1c3-0e7b354b8a9c', 'f391791a-7fc6-45b6-9404-1bc5b6e0f4ef', '7588a344-23e3-4e7e-81cd-1f9c1b253b31'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:20 devstack sudo[100016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:03:20 devstack sudo[100016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:20 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d" returned: 0 in 0.982s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:03:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:20 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 Sep 03 12:03:20 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:21 devstack sudo[100016]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.631s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:21 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:03:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Deleted volume successfully. Sep 03 12:03:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2058737-f05d-49d5-8baf-b031bac0ed96 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "cinder-c8d835ea-56bf-48a7-911c-530c0059a862-delete_volume" released by "delete_volume" :: held 2.918s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Flow 'volume_create_manager' (0e7d54ad-2019-4dbd-926d-4e81d381d5ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f18068-4697-4dfb-b798-e0c699e3213e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f18068-4697-4dfb-b798-e0c699e3213e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1992121934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edea155-cdf0-4533-8bcd-949bf5260218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c0d8a43f2448af96d7ae8d74f9ae56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:22Z,use_quota=True,user_id='09efbb91fd424db6a208af39b343de47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a7707b-fdbc-46e6-b665-6921bfe34800) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1a7707b-fdbc-46e6-b665-6921bfe34800) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6960a5b1-ae9f-452f-aab4-f02bd064615b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6960a5b1-ae9f-452f-aab4-f02bd064615b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1edea155-cdf0-4533-8bcd-949bf5260218', 'volume_name': 'volume-1edea155-cdf0-4533-8bcd-949bf5260218', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12fb4a8-bbc2-4524-a1c2-47401f33265e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c12fb4a8-bbc2-4524-a1c2-47401f33265e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4ee92f-a1a8-49e5-8ed7-ceac0ff86567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:22 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Volume 1edea155-cdf0-4533-8bcd-949bf5260218: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1edea155-cdf0-4533-8bcd-949bf5260218', 'volume_size': 1} Sep 03 12:03:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:29 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1" returned: 0 in 8.822s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:29 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d, size 1024.00 MB, duration 8.82 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:03:29 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Converted 1024.00 MB image at 116.06 MB/s Sep 03 12:03:29 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 is being set with open permissions: ugo+rw Sep 03 12:03:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:29 devstack sudo[100097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 Sep 03 12:03:29 devstack sudo[100097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:29 devstack sudo[100097]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1" returned: 0 in 0.359s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-742ba8df-458a-4432-bd29-fb317e6d42b1" released by "_copy_volume_from_snapshot" :: held 11.423s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-b432f668-e12d-4a02-b798-228b88136f41-742ba8df-458a-4432-bd29-fb317e6d42b1" released by "_create_volume_from_snapshot" :: held 11.531s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.561s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.621s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1992121934',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1edea155-cdf0-4533-8bcd-949bf5260218,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='67c0d8a43f2448af96d7ae8d74f9ae56',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:22Z,use_quota=True,user_id='09efbb91fd424db6a208af39b343de47',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Creating volume 1edea155-cdf0-4533-8bcd-949bf5260218 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:03:30 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:30 devstack sudo[100100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 1073741824 Sep 03 12:03:30 devstack sudo[100100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6b359e7-5751-4ffd-990b-f8a08f2af810) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-742ba8df-458a-4432-bd29-fb317e6d42b1', 'volume_size': 1, 'snapshot_id': 'b432f668-e12d-4a02-b798-228b88136f41'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f97b9f9-54b6-4c1b-98bb-d4e20697b726) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:30 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Volume volume-742ba8df-458a-4432-bd29-fb317e6d42b1 (742ba8df-458a-4432-bd29-fb317e6d42b1): created successfully Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f97b9f9-54b6-4c1b-98bb-d4e20697b726) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Flow 'volume_create_manager' (bfd2ff69-fc1a-42e7-8401-4d1ac7fe1edd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-68579d51-799d-498e-8fe3-833ad149e7da tempest-TestStampPattern-11950540 None] Created volume successfully. Sep 03 12:03:30 devstack sudo[100100]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 1073741824" returned: 0 in 0.683s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:30 devstack sudo[100118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 Sep 03 12:03:30 devstack sudo[100118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:31 devstack sudo[100118]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218" returned: 0 in 0.361s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] <== create_volume: return (1117ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:03:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.122s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c4ee92f-a1a8-49e5-8ed7-ceac0ff86567) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1edea155-cdf0-4533-8bcd-949bf5260218', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2225cadb-3b06-491c-88bd-b889b3c1b175) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:31 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Volume volume-1edea155-cdf0-4533-8bcd-949bf5260218 (1edea155-cdf0-4533-8bcd-949bf5260218): created successfully Sep 03 12:03:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2225cadb-3b06-491c-88bd-b889b3c1b175) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Flow 'volume_create_manager' (0e7d54ad-2019-4dbd-926d-4e81d381d5ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d9906067-948b-4bd8-a1f4-8e06f71f6df2 tempest-VolumeQuotasAdminTestJSON-203028630 None] Created volume successfully. Sep 03 12:03:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8f26c10d-42f0-4a27-b826-283c4ead7926 tempest-VolumeQuotasAdminTestJSON-1494161146 None] Transfer volume completed successfully. Sep 03 12:03:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Acquiring lock "cinder-1edea155-cdf0-4533-8bcd-949bf5260218-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Lock "cinder-1edea155-cdf0-4533-8bcd-949bf5260218-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Acquiring lock "cinder-quobyte-1edea155-cdf0-4533-8bcd-949bf5260218" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Lock "cinder-quobyte-1edea155-cdf0-4533-8bcd-949bf5260218" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:33 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1184d40c-5659-4f02-8965-52a7f6610533]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:34 devstack sudo[100182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 Sep 03 12:03:34 devstack sudo[100182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:34 devstack sudo[100182]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218" returned: 0 in 0.772s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:34 devstack sudo[100191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218 Sep 03 12:03:34 devstack sudo[100191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:35 devstack sudo[100191]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1edea155-cdf0-4533-8bcd-949bf5260218" returned: 0 in 0.566s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Lock "cinder-quobyte-1edea155-cdf0-4533-8bcd-949bf5260218" released by "delete_volume" :: held 1.425s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Created reservations ['5fdd9222-5e7e-46ea-ab78-ff4745dc8cdf', '77bf3adc-1733-4b4d-a8c0-c87f7f74ac92', '7e4a8d63-9224-4ca5-9eff-25469077a7aa', '3de7c297-a45c-4a08-ab06-8fdca83c84e9'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:35 devstack sudo[100195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:03:35 devstack sudo[100195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:36 devstack sudo[100195]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.812s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:36 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:03:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Deleted volume successfully. Sep 03 12:03:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f68fa86d-b822-4466-a2bd-3592c0693d88 tempest-VolumeQuotasAdminTestJSON-1200140215 None] Lock "cinder-1edea155-cdf0-4533-8bcd-949bf5260218-delete_volume" released by "delete_volume" :: held 2.805s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Acquiring lock "cinder-7dd8edcb-291d-4230-a415-64fcaf75bd38-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Lock "cinder-7dd8edcb-291d-4230-a415-64fcaf75bd38-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:43 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=77,cinder:INSERT=23,cinder:UPDATE=96,cinder:DELETE=7 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:03:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Acquiring lock "cinder-quobyte-7dd8edcb-291d-4230-a415-64fcaf75bd38" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:03:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Lock "cinder-quobyte-7dd8edcb-291d-4230-a415-64fcaf75bd38" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:03:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b6859a5-3699-41e5-ae10-9053ef463d3b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:44 devstack sudo[100267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 Sep 03 12:03:44 devstack sudo[100267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:44 devstack sudo[100267]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38" returned: 0 in 1.050s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:45 devstack sudo[100317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38 Sep 03 12:03:45 devstack sudo[100317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:45 devstack sudo[100317]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dd8edcb-291d-4230-a415-64fcaf75bd38" returned: 0 in 0.638s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Lock "cinder-quobyte-7dd8edcb-291d-4230-a415-64fcaf75bd38" released by "delete_volume" :: held 1.806s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Created reservations ['502bacd8-30bf-4095-9bf0-c5d0e5af6ce5', '8855d838-fcde-45b7-a719-b3679a93754a', 'fcf65aae-76f0-428c-8bae-73da4ac9121e', '2249b785-7783-4da4-902c-7ab2d8767635'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:45 devstack sudo[100330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:03:45 devstack sudo[100330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:46 devstack sudo[100330]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.545s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:46 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:03:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Deleted volume successfully. Sep 03 12:03:46 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-367354f6-c1b7-43d6-914b-007f694bc0b8 tempest-VolumesNegativeTest-1083768885 None] Lock "cinder-7dd8edcb-291d-4230-a415-64fcaf75bd38-delete_volume" released by "delete_volume" :: held 2.826s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Flow 'volume_create_manager' (7faa899c-058c-496e-a963-17082faab4e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b0b719-8e4e-4aeb-a36f-7e3ecaefe692) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b0b719-8e4e-4aeb-a36f-7e3ecaefe692) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2094510680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94697822-f845-4bfd-9486-d645fe83b64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b747e7d88c2456e88c2190947cb1a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:49Z,use_quota=True,user_id='da4e58c105b84384a7e17646ec9bfcd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eab0976-20da-4bf8-b16d-3949af0ebe28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0eab0976-20da-4bf8-b16d-3949af0ebe28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805deef8-52c8-443b-b4d2-2a750a9b80ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (805deef8-52c8-443b-b4d2-2a750a9b80ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '94697822-f845-4bfd-9486-d645fe83b64f', 'volume_name': 'volume-94697822-f845-4bfd-9486-d645fe83b64f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24188aa6-1a48-411c-b848-6319317eb797) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (24188aa6-1a48-411c-b848-6319317eb797) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c84e750-843a-4b3f-b6ed-dc24ea1e98a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Volume 94697822-f845-4bfd-9486-d645fe83b64f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-94697822-f845-4bfd-9486-d645fe83b64f', 'volume_size': 1} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-2094510680',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=94697822-f845-4bfd-9486-d645fe83b64f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1b747e7d88c2456e88c2190947cb1a83',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:49Z,use_quota=True,user_id='da4e58c105b84384a7e17646ec9bfcd0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Creating volume 94697822-f845-4bfd-9486-d645fe83b64f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:03:49 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:49 devstack sudo[100346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f 1073741824 Sep 03 12:03:49 devstack sudo[100346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:49 devstack sudo[100346]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f 1073741824" returned: 0 in 0.582s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:49 devstack sudo[100352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f Sep 03 12:03:49 devstack sudo[100352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:50 devstack sudo[100352]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f" returned: 0 in 0.369s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] <== create_volume: return (1015ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2c84e750-843a-4b3f-b6ed-dc24ea1e98a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-94697822-f845-4bfd-9486-d645fe83b64f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd6fa67-8bae-437b-8dfd-10f0fc55f7c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Flow 'volume_create_manager' (ceb19ecb-963b-491d-af67-6baa353b91e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e922e6d0-d456-42c2-be6b-3c56bc6f92ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e922e6d0-d456-42c2-be6b-3c56bc6f92ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1930951322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5d7b27-107f-47e0-984d-bdc99300c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1bcd30d88304ebba59937c5adaa0bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:50Z,use_quota=True,user_id='8771f73fcc744badb2c4193fba41a06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc46d0e-6cf5-4107-a062-ac4e05500981) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1cc46d0e-6cf5-4107-a062-ac4e05500981) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13c571d-1b75-42c0-9dc9-a289d320b9c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d13c571d-1b75-42c0-9dc9-a289d320b9c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dc5d7b27-107f-47e0-984d-bdc99300c6f3', 'volume_name': 'volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35ec178-f107-4c2b-9a8a-d99e7f3a5e81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35ec178-f107-4c2b-9a8a-d99e7f3a5e81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918b329f-92a4-4d1a-b0e7-491e3ec9b9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Volume dc5d7b27-107f-47e0-984d-bdc99300c6f3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3', 'volume_size': 1} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1930951322',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dc5d7b27-107f-47e0-984d-bdc99300c6f3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f1bcd30d88304ebba59937c5adaa0bc3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:50Z,use_quota=True,user_id='8771f73fcc744badb2c4193fba41a06f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Creating volume dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:03:50 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Volume volume-94697822-f845-4bfd-9486-d645fe83b64f (94697822-f845-4bfd-9486-d645fe83b64f): created successfully Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3bd6fa67-8bae-437b-8dfd-10f0fc55f7c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Flow 'volume_create_manager' (7faa899c-058c-496e-a963-17082faab4e5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:50 devstack sudo[100355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 1073741824 Sep 03 12:03:50 devstack sudo[100355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f17b4f67-15c8-4b1a-b2dc-c779b2ab1f27 tempest-TestMinimumBasicScenario-1566718723 None] Created volume successfully. Sep 03 12:03:50 devstack sudo[100355]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 1073741824" returned: 0 in 0.488s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:50 devstack sudo[100360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 Sep 03 12:03:50 devstack sudo[100360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:51 devstack sudo[100360]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3" returned: 0 in 0.311s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:03:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (918b329f-92a4-4d1a-b0e7-491e3ec9b9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b78257-0f16-450d-9399-f1d2ffcc307a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Volume volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 (dc5d7b27-107f-47e0-984d-bdc99300c6f3): created successfully Sep 03 12:03:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28b78257-0f16-450d-9399-f1d2ffcc307a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Flow 'volume_create_manager' (ceb19ecb-963b-491d-af67-6baa353b91e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9d215c3a-4856-456a-aa44-bfb15eccb64e tempest-VolumesSnapshotListTestJSON-965826142 None] Created volume successfully. Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-474378a4-ae12-4d85-b535-fcff53e148a4 req-aa95182f-77e6-4734-a7c5-c529d33a8081 tempest-TestMinimumBasicScenario-1566718723 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-474378a4-ae12-4d85-b535-fcff53e148a4 req-aa95182f-77e6-4734-a7c5-c529d33a8081 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-474378a4-ae12-4d85-b535-fcff53e148a4 req-aa95182f-77e6-4734-a7c5-c529d33a8081 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-474378a4-ae12-4d85-b535-fcff53e148a4 req-aa95182f-77e6-4734-a7c5-c529d33a8081 tempest-TestMinimumBasicScenario-1566718723 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-94697822-f845-4bfd-9486-d645fe83b64f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4f9fef45-ae4d-4de5-b465-797ac8349a9e', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:03:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-474378a4-ae12-4d85-b535-fcff53e148a4 req-aa95182f-77e6-4734-a7c5-c529d33a8081 tempest-TestMinimumBasicScenario-1566718723 None] attachment_update completed successfully. Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Creating offline snapshot d225fc07-12e1-4456-98fe-4f5e002d27e0 of volume dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec883595-d349-4635-8570-fd29933583ef]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:52 devstack sudo[100421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 Sep 03 12:03:52 devstack sudo[100421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:53 devstack sudo[100421]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3" returned: 0 in 0.565s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:53 devstack sudo[100762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 1G Sep 03 12:03:53 devstack sudo[100762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:53 devstack sudo[100762]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 1G" returned: 0 in 0.548s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:53 devstack sudo[100769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 Sep 03 12:03:53 devstack sudo[100769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:54 devstack sudo[100769]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0" returned: 0 in 0.368s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:54 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 is being set with open permissions: ugo+rw Sep 03 12:03:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:54 devstack sudo[100774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 Sep 03 12:03:54 devstack sudo[100774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:54 devstack sudo[100774]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0" returned: 0 in 0.371s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:54 devstack sudo[100777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.info Sep 03 12:03:54 devstack sudo[100777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:54 devstack sudo[100777]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.info" returned: 0 in 0.334s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:54 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.info is being set with open permissions: ugo+rw Sep 03 12:03:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:55 devstack sudo[100780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.info Sep 03 12:03:55 devstack sudo[100780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:55 devstack sudo[100780]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.info" returned: 0 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.629s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-83e6eb34-be3e-4387-9dff-d1f08b211653 tempest-VolumesSnapshotListTestJSON-965826142 None] Create snapshot completed successfully Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Creating offline snapshot 72b85716-5e2b-4483-923e-f28b693c54aa of volume dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cd4e361-9bf1-422b-ab90-fc8a00ed3c9c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:56 devstack sudo[100783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 Sep 03 12:03:56 devstack sudo[100783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:56 devstack sudo[100783]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0" returned: 0 in 0.530s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:03:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:56 devstack sudo[100789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa 1G Sep 03 12:03:56 devstack sudo[100789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:57 devstack sudo[100789]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa 1G" returned: 0 in 0.872s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:03:57 devstack sudo[100796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa Sep 03 12:03:57 devstack sudo[100796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Flow 'volume_create_manager' (a9fd90b9-3bf3-44bb-8428-13c015f26920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554b1765-bc87-4766-8344-a19e7881d49a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (554b1765-bc87-4766-8344-a19e7881d49a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1884408386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5f84cc-1aed-4e60-b1f4-2110e1289e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857b552abee44ffcbb3acbefd5f8f2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:58Z,use_quota=True,user_id='db6547ca7b924c8880b8fa0290a26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf4ad870-4348-4d8d-b7ba-115ad954c420),volume_type_id=bf4ad870-4348-4d8d-b7ba-115ad954c420)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b407ea-68d2-4faf-a5f7-5d27ffd96918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30b407ea-68d2-4faf-a5f7-5d27ffd96918) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90b91f-be0b-45dd-b1ee-eae8650eed2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec90b91f-be0b-45dd-b1ee-eae8650eed2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1d5f84cc-1aed-4e60-b1f4-2110e1289e21', 'volume_name': 'volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bacb63-12bb-448c-9085-15a9c8fcd19a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25bacb63-12bb-448c-9085-15a9c8fcd19a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b38795-70b1-4a55-8561-fd907f031b67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:03:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Volume 1d5f84cc-1aed-4e60-b1f4-2110e1289e21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21', 'volume_size': 1} Sep 03 12:03:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:58 devstack sudo[100796]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa" returned: 0 in 0.620s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:58 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa is being set with open permissions: ugo+rw Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:58 devstack sudo[100803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa Sep 03 12:03:58 devstack sudo[100803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:58 devstack sudo[100803]: pam_unix(sudo:session): session closed for user root Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa" returned: 0 in 0.482s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.656s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.956s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:03:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1884408386',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1d5f84cc-1aed-4e60-b1f4-2110e1289e21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='857b552abee44ffcbb3acbefd5f8f2d9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:03:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:03:58Z,use_quota=True,user_id='db6547ca7b924c8880b8fa0290a26750',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(bf4ad870-4348-4d8d-b7ba-115ad954c420),volume_type_id=bf4ad870-4348-4d8d-b7ba-115ad954c420)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Creating volume 1d5f84cc-1aed-4e60-b1f4-2110e1289e21 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:03:58 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:03:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:03:58 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 1073741824 Sep 03 12:03:58 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:03:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d442bf51-409a-4a4c-8202-ecd324470766 tempest-VolumesSnapshotListTestJSON-965826142 None] Create snapshot completed successfully Sep 03 12:03:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:00 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 1073741824" returned: 0 in 1.145s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:00 devstack sudo[100843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 Sep 03 12:04:00 devstack sudo[100843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:00 devstack sudo[100843]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21" returned: 0 in 0.535s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] <== create_volume: return (1814ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.821s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.753s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99b38795-70b1-4a55-8561-fd907f031b67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edbdb07-74bd-4089-8292-327eaea6bc4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Creating offline snapshot 6836997e-23da-464d-a89e-b9d195b1c45e of volume dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:04:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Volume volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 (1d5f84cc-1aed-4e60-b1f4-2110e1289e21): created successfully Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9edbdb07-74bd-4089-8292-327eaea6bc4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Flow 'volume_create_manager' (a9fd90b9-3bf3-44bb-8428-13c015f26920) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[70fac703-ee9e-4b18-87b3-db5edfc1f926]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6ba2d7a9-61e0-4698-93f7-25843c918de2 tempest-VolumeTypesAccessTest-1373472013 None] Created volume successfully. Sep 03 12:04:01 devstack sudo[100846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa Sep 03 12:04:01 devstack sudo[100846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Acquiring lock "cinder-1d5f84cc-1aed-4e60-b1f4-2110e1289e21-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Lock "cinder-1d5f84cc-1aed-4e60-b1f4-2110e1289e21-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Acquiring lock "cinder-quobyte-1d5f84cc-1aed-4e60-b1f4-2110e1289e21" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Lock "cinder-quobyte-1d5f84cc-1aed-4e60-b1f4-2110e1289e21" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7342717-aae0-4fec-882f-2e503721a01c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:01 devstack sudo[100846]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa" returned: 0 in 0.538s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:01 devstack sudo[100848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 Sep 03 12:04:01 devstack sudo[100848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:01 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e 1G Sep 03 12:04:01 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:01 devstack sudo[100848]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21" returned: 0 in 0.433s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:01 devstack sudo[100865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21 Sep 03 12:04:01 devstack sudo[100865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:02 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e 1G" returned: 0 in 0.668s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:02 devstack sudo[100865]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1d5f84cc-1aed-4e60-b1f4-2110e1289e21" returned: 0 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:02 devstack sudo[100870]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e Sep 03 12:04:02 devstack sudo[100870]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Lock "cinder-quobyte-1d5f84cc-1aed-4e60-b1f4-2110e1289e21" released by "delete_volume" :: held 0.896s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:02 devstack cinder-volume[87256]: WARNING cinder.quota [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-40187063 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-40187063, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:04:02 devstack cinder-volume[87256]: WARNING cinder.quota [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-40187063 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-40187063, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Created reservations ['60bd9cfd-dbb4-4ac4-9676-947c944f74fc', '2e48686e-1c34-40ad-9695-f84e1736ccf7', '4e5e1a7d-a268-4a2c-9f84-af2a00233259', 'fca2ffa1-8ff8-45f3-89af-ed41ebe7aa97'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:02 devstack sudo[100873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:02 devstack sudo[100873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:02 devstack sudo[100870]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e" returned: 0 in 0.526s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:02 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e is being set with open permissions: ugo+rw Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:02 devstack sudo[100878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e Sep 03 12:04:02 devstack sudo[100878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:02 devstack sudo[100873]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.358s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Deleted volume successfully. Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5795a990-b4d1-4a90-a0bf-8040d2d2abdb tempest-VolumeTypesAccessTest-1373472013 None] Lock "cinder-1d5f84cc-1aed-4e60-b1f4-2110e1289e21-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-65ca6f3b-2b64-473a-9d4e-398f61aa219a req-05dfbd65-cd2d-4bcd-be7b-eb394f40bcce tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:02 devstack sudo[100878]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e" returned: 0 in 0.279s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.218s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-65ca6f3b-2b64-473a-9d4e-398f61aa219a req-05dfbd65-cd2d-4bcd-be7b-eb394f40bcce tempest-TestStampPattern-11950540 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.054s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-65ca6f3b-2b64-473a-9d4e-398f61aa219a req-05dfbd65-cd2d-4bcd-be7b-eb394f40bcce tempest-TestStampPattern-11950540 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0f48d73e-97d5-41ee-a5c1-5e77b463f1f4 tempest-VolumesSnapshotListTestJSON-965826142 None] Create snapshot completed successfully Sep 03 12:04:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-65ca6f3b-2b64-473a-9d4e-398f61aa219a req-05dfbd65-cd2d-4bcd-be7b-eb394f40bcce tempest-TestStampPattern-11950540 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-742ba8df-458a-4432-bd29-fb317e6d42b1', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '93d578fd-7505-48b6-ae16-9a76e0737fb5', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:04:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-65ca6f3b-2b64-473a-9d4e-398f61aa219a req-05dfbd65-cd2d-4bcd-be7b-eb394f40bcce tempest-TestStampPattern-11950540 None] attachment_update completed successfully. Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-6836997e-23da-464d-a89e-b9d195b1c45e-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-6836997e-23da-464d-a89e-b9d195b1c45e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-quobyte-6836997e-23da-464d-a89e-b9d195b1c45e" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-6836997e-23da-464d-a89e-b9d195b1c45e" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Deleting offline snapshot 6836997e-23da-464d-a89e-b9d195b1c45e of volume dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] snapshot_file for this snap is: volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc50a2fb-004f-4dec-bbf6-da4aa983e6c7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:04 devstack sudo[100894]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e Sep 03 12:04:04 devstack sudo[100894]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:04 devstack sudo[100894]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e" returned: 0 in 0.428s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[18bbfb21-8f2b-4ea7-b76a-bc252007d2d2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:04 devstack sudo[100899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa Sep 03 12:04:04 devstack sudo[100899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:05 devstack sudo[100899]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa" returned: 0 in 0.400s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:05 devstack sudo[100912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e Sep 03 12:04:05 devstack sudo[100912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:05 devstack sudo[100912]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e" returned: 0 in 0.526s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:05 devstack sudo[100926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e Sep 03 12:04:05 devstack sudo[100926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:05 devstack sudo[100926]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.6836997e-23da-464d-a89e-b9d195b1c45e" returned: 0 in 0.300s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-6836997e-23da-464d-a89e-b9d195b1c45e" released by "_delete_snapshot" :: held 1.792s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" released by "delete_snapshot" :: held 1.829s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Created reservations ['0bad28de-4c5b-49a2-98b1-6c32fe3aa554', 'b1832c26-3522-4e56-8f66-1e551b517f91', 'fd452b31-21ca-4012-b2b4-4b2517fc3d9b', 'f103d0f1-0dcd-4492-8981-a513e9db90f7'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Delete snapshot completed successfully. Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c09caf51-0267-4f74-ad2e-cbb3b9833ace tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-6836997e-23da-464d-a89e-b9d195b1c45e-delete_snapshot" released by "delete_snapshot" :: held 2.170s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-72b85716-5e2b-4483-923e-f28b693c54aa-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-72b85716-5e2b-4483-923e-f28b693c54aa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-quobyte-72b85716-5e2b-4483-923e-f28b693c54aa" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-72b85716-5e2b-4483-923e-f28b693c54aa" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Deleting offline snapshot 72b85716-5e2b-4483-923e-f28b693c54aa of volume dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] snapshot_file for this snap is: volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd8214f2-f157-4bf6-b57e-61cff67d4115]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-a8bc4770-fc2e-4e32-8a9d-26037a6cfb9a req-c773131e-da54-44ec-9446-bdad38305e3c tempest-TestStampPattern-11950540 None] Terminate volume connection completed successfully. Sep 03 12:04:06 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-a8bc4770-fc2e-4e32-8a9d-26037a6cfb9a req-c773131e-da54-44ec-9446-bdad38305e3c tempest-TestStampPattern-11950540 None] Deleting attachment 93d578fd-7505-48b6-ae16-9a76e0737fb5. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:04:06 devstack sudo[100931]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa Sep 03 12:04:06 devstack sudo[100931]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:07 devstack sudo[100931]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa" returned: 0 in 0.495s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[fdf218b4-153e-4c47-94b9-9c840ce21d68]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:07 devstack sudo[100941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 Sep 03 12:04:07 devstack sudo[100941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:07 devstack sudo[100941]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0" returned: 0 in 0.446s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:07 devstack sudo[100947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa Sep 03 12:04:07 devstack sudo[100947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:07 devstack sudo[100947]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa" returned: 0 in 0.463s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:08 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa Sep 03 12:04:08 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:08 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.72b85716-5e2b-4483-923e-f28b693c54aa" returned: 0 in 0.374s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-72b85716-5e2b-4483-923e-f28b693c54aa" released by "_delete_snapshot" :: held 1.945s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" released by "delete_snapshot" :: held 1.981s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:08 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Created reservations ['b2792b1c-cd2f-41c3-837b-a1bd44a5242f', '7ad294f2-00b9-496f-b1f2-b964013bbea2', 'c6718c0c-1e9a-421b-bc57-b88f792932e0', '65a99683-a569-4bc7-b4f6-8f79ac2a9afe'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Delete snapshot completed successfully. Sep 03 12:04:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7530551c-89ee-43f4-9c9e-302769d6d9bc tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-72b85716-5e2b-4483-923e-f28b693c54aa-delete_snapshot" released by "delete_snapshot" :: held 2.308s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-d225fc07-12e1-4456-98fe-4f5e002d27e0-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-d225fc07-12e1-4456-98fe-4f5e002d27e0-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" acquired by "delete_snapshot" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-quobyte-d225fc07-12e1-4456-98fe-4f5e002d27e0" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-d225fc07-12e1-4456-98fe-4f5e002d27e0" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Deleting offline snapshot d225fc07-12e1-4456-98fe-4f5e002d27e0 of volume dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] snapshot_file for this snap is: volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a9c0974-f514-4a01-836a-52243eddbcfa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:10 devstack sudo[100986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 Sep 03 12:04:10 devstack sudo[100986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:10 devstack sudo[100986]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0" returned: 0 in 0.584s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:10 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0530f31-74fe-4361-9b57-75ae4b05a409]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:10 devstack sudo[100995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 Sep 03 12:04:10 devstack sudo[100995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:11 devstack sudo[100995]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3" returned: 0 in 0.542s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:11 devstack sudo[101001]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 Sep 03 12:04:11 devstack sudo[101001]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:11 devstack sudo[101001]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0" returned: 0 in 0.496s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:11 devstack sudo[101007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0 Sep 03 12:04:11 devstack sudo[101007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-742ba8df-458a-4432-bd29-fb317e6d42b1-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Lock "cinder-742ba8df-458a-4432-bd29-fb317e6d42b1-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-quobyte-742ba8df-458a-4432-bd29-fb317e6d42b1" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:11 devstack sudo[101007]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3.d225fc07-12e1-4456-98fe-4f5e002d27e0" returned: 0 in 0.275s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-742ba8df-458a-4432-bd29-fb317e6d42b1" acquired by "delete_volume" :: waited 0.053s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-d225fc07-12e1-4456-98fe-4f5e002d27e0" released by "_delete_snapshot" :: held 2.126s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1091034-f484-4a12-839e-624f087125e2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" released by "delete_snapshot" :: held 2.167s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Created reservations ['86264fc8-ef92-4661-bd7e-0a9bc7baa9f4', 'f07276cc-cb4d-4314-bc0f-2b2bc04c7ad5', '240ca755-0887-4586-aa93-cd76badb9173', '33643f58-ec35-4608-bed9-eb88076476d2'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:12 devstack sudo[101010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 Sep 03 12:04:12 devstack sudo[101010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:12 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Delete snapshot completed successfully. Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-23e4e8f1-7e31-438d-9dcc-fc1431df83b2 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-d225fc07-12e1-4456-98fe-4f5e002d27e0-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:12 devstack sudo[101010]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1" returned: 0 in 0.432s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:12 devstack sudo[101016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1 Sep 03 12:04:12 devstack sudo[101016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:12 devstack sudo[101016]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-742ba8df-458a-4432-bd29-fb317e6d42b1" returned: 0 in 0.299s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-742ba8df-458a-4432-bd29-fb317e6d42b1" released by "delete_volume" :: held 0.781s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Created reservations ['a7cf3a12-0d53-4095-b477-862f8ac032fa', 'ff5f95e7-7540-403c-bb3a-98c5b09ffe19', 'd437e8bd-0c99-4490-bc8c-af9ebcb036b1', 'd23cdf94-c5c2-46d1-9713-3e9e34aaaee9'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:12 devstack sudo[101043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:12 devstack sudo[101043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-dc5d7b27-107f-47e0-984d-bdc99300c6f3-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-dc5d7b27-107f-47e0-984d-bdc99300c6f3-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:13 devstack sudo[101043]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.273s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:13 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Deleted volume successfully. Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ee706d5-0eea-4492-bd2a-b354ff718547 tempest-TestStampPattern-11950540 None] Lock "cinder-742ba8df-458a-4432-bd29-fb317e6d42b1-delete_volume" released by "delete_volume" :: held 1.366s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8695266-a140-4622-b71f-66465489cc33]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:13 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 Sep 03 12:04:13 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-b432f668-e12d-4a02-b798-228b88136f41-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Lock "cinder-b432f668-e12d-4a02-b798-228b88136f41-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-quobyte-916a121a-7f74-48a6-a002-2d86bf7c7a8d" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:13 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-916a121a-7f74-48a6-a002-2d86bf7c7a8d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-quobyte-b432f668-e12d-4a02-b798-228b88136f41" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3" returned: 0 in 0.465s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-b432f668-e12d-4a02-b798-228b88136f41" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:13 devstack sudo[101054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3 Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Deleting offline snapshot b432f668-e12d-4a02-b798-228b88136f41 of volume 916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:04:13 devstack sudo[101054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] snapshot_file for this snap is: volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a4737a8-003c-4ddf-be8e-4b577de2e912]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:13 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 Sep 03 12:04:13 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:14 devstack sudo[101054]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dc5d7b27-107f-47e0-984d-bdc99300c6f3" returned: 0 in 0.303s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-quobyte-dc5d7b27-107f-47e0-984d-bdc99300c6f3" released by "delete_volume" :: held 0.849s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Created reservations ['7b691076-0c5b-4995-9882-4089240b7794', '0ebd9369-d266-4410-99c3-5df20d5fc5bc', '5b76c287-1901-4364-bb22-ec28b1e9ee13', 'b6fbd2d8-3db2-4dda-bef1-9f0c8850aa47'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:14 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:14 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:14 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7348381c-4b03-4d64-9467-2f8d847e27dd]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:14 devstack sudo[101067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d Sep 03 12:04:14 devstack sudo[101067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:14 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.322s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Deleted volume successfully. Sep 03 12:04:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-bf7bdb1f-b27d-4760-b9a9-84cecaa7a996 tempest-VolumesSnapshotListTestJSON-965826142 None] Lock "cinder-dc5d7b27-107f-47e0-984d-bdc99300c6f3-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:15 devstack sudo[101067]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d" returned: 0 in 0.761s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:15 devstack sudo[101095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 Sep 03 12:04:15 devstack sudo[101095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:15 devstack sudo[101095]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41" returned: 0 in 0.528s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:15 devstack sudo[101101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41 Sep 03 12:04:15 devstack sudo[101101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:16 devstack sudo[101101]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d.b432f668-e12d-4a02-b798-228b88136f41" returned: 0 in 0.550s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-b432f668-e12d-4a02-b798-228b88136f41" released by "_delete_snapshot" :: held 2.475s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-916a121a-7f74-48a6-a002-2d86bf7c7a8d" released by "delete_snapshot" :: held 2.530s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:16 devstack sudo[101106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:16 devstack sudo[101106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Created reservations ['a0e9e3de-0602-487a-ac98-98224b78f26b', '721f0821-07c0-4008-bddc-5598b59a211f', '95f48812-281e-4c47-8354-90eaf6fd570f', '313cfe9f-3510-4a51-8385-fdec5aa57b95'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Delete snapshot completed successfully. Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6c5b914f-6c8d-4111-841d-2ccfa6d4d818 tempest-TestStampPattern-11950540 None] Lock "cinder-b432f668-e12d-4a02-b798-228b88136f41-delete_snapshot" released by "delete_snapshot" :: held 2.841s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:16 devstack sudo[101106]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.450s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:04:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-916a121a-7f74-48a6-a002-2d86bf7c7a8d-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Lock "cinder-916a121a-7f74-48a6-a002-2d86bf7c7a8d-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=89,cinder:INSERT=27,cinder:UPDATE=76,cinder:DELETE=7 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Acquiring lock "cinder-quobyte-916a121a-7f74-48a6-a002-2d86bf7c7a8d" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-916a121a-7f74-48a6-a002-2d86bf7c7a8d" acquired by "delete_volume" :: waited 0.051s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6804a93-b5aa-468f-8f05-e5ae5bfb4cfe]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:23 devstack sudo[101139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d Sep 03 12:04:23 devstack sudo[101139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:23 devstack sudo[101139]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d" returned: 0 in 0.466s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:23 devstack sudo[101145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d Sep 03 12:04:23 devstack sudo[101145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:24 devstack sudo[101145]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-916a121a-7f74-48a6-a002-2d86bf7c7a8d" returned: 0 in 0.437s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Lock "cinder-quobyte-916a121a-7f74-48a6-a002-2d86bf7c7a8d" released by "delete_volume" :: held 1.006s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Created reservations ['42855b68-b5a3-41ef-ad32-60736478f115', '30bd75f9-89d3-4b10-95bc-a591dc69968b', 'c5c35040-31f3-4de5-8c9d-37fb5df3d040', 'a5564cc3-a2a9-4878-800a-183e5797ee49'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:24 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:24 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:24 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.336s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Deleted volume successfully. Sep 03 12:04:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a88f46b8-37c1-47e8-b867-84424ff91711 tempest-TestStampPattern-11950540 None] Lock "cinder-916a121a-7f74-48a6-a002-2d86bf7c7a8d-delete_volume" released by "delete_volume" :: held 1.753s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Flow 'volume_create_manager' (c6261df8-5774-49f8-870c-5bc793dd6ec0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96776cd9-1286-4a56-ac0b-1b058f97d9d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96776cd9-1286-4a56-ac0b-1b058f97d9d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-649581217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1161769-79b2-438e-8c1b-13af71e514d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe5d60b95d745b59673830b216315a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:26Z,use_quota=True,user_id='35432ca338fe40f3bbdfb9f94ae35bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf76797-f72a-4fe5-827d-2424a0334df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdf76797-f72a-4fe5-827d-2424a0334df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a421ed91-22e4-4b54-8709-5c18f4e071f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a421ed91-22e4-4b54-8709-5c18f4e071f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1161769-79b2-438e-8c1b-13af71e514d6', 'volume_name': 'volume-b1161769-79b2-438e-8c1b-13af71e514d6', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6444950f-d54c-4b8d-adce-3b0d192c5f53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6444950f-d54c-4b8d-adce-3b0d192c5f53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af94714d-27a8-4f4e-b5f0-8f69685706f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Volume b1161769-79b2-438e-8c1b-13af71e514d6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1161769-79b2-438e-8c1b-13af71e514d6', 'volume_size': 1} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-649581217',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1161769-79b2-438e-8c1b-13af71e514d6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cbe5d60b95d745b59673830b216315a4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:26Z,use_quota=True,user_id='35432ca338fe40f3bbdfb9f94ae35bf4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Creating volume b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:26 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:26 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 1073741824 Sep 03 12:04:26 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:27 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 1073741824" returned: 0 in 0.615s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:27 devstack sudo[101194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 Sep 03 12:04:27 devstack sudo[101194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:27 devstack sudo[101194]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6" returned: 0 in 0.341s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.082s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af94714d-27a8-4f4e-b5f0-8f69685706f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1161769-79b2-438e-8c1b-13af71e514d6', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf6cb69-9d23-44f2-a8c4-5e6878a9d8cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:27 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Volume volume-b1161769-79b2-438e-8c1b-13af71e514d6 (b1161769-79b2-438e-8c1b-13af71e514d6): created successfully Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ebf6cb69-9d23-44f2-a8c4-5e6878a9d8cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Flow 'volume_create_manager' (c6261df8-5774-49f8-870c-5bc793dd6ec0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0f73efd1-327b-4009-8033-524ee2c0b26d tempest-SnapshotMetadataTestJSON-1678533905 None] Created volume successfully. Sep 03 12:04:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Creating offline snapshot 1031f6a2-b317-4a1e-b8f1-20ee6d38d137 of volume b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:04:28 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0348b947-d47b-4d0d-88dd-82657bbe05c1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:28 devstack sudo[101197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 Sep 03 12:04:28 devstack sudo[101197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:29 devstack sudo[101197]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6" returned: 0 in 0.573s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:29 devstack sudo[101206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 1G Sep 03 12:04:29 devstack sudo[101206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:29 devstack sudo[101206]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 1G" returned: 0 in 0.618s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1161769-79b2-438e-8c1b-13af71e514d6 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:30 devstack sudo[101212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1161769-79b2-438e-8c1b-13af71e514d6 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 Sep 03 12:04:30 devstack sudo[101212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:30 devstack sudo[101212]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b1161769-79b2-438e-8c1b-13af71e514d6 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137" returned: 0 in 0.343s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:30 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 is being set with open permissions: ugo+rw Sep 03 12:04:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:30 devstack sudo[101218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 Sep 03 12:04:30 devstack sudo[101218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:30 devstack sudo[101218]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137" returned: 0 in 0.309s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:30 devstack sudo[101221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.info Sep 03 12:04:30 devstack sudo[101221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:31 devstack sudo[101221]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.info" returned: 0 in 0.308s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:31 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.info is being set with open permissions: ugo+rw Sep 03 12:04:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:31 devstack sudo[101224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.info Sep 03 12:04:31 devstack sudo[101224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:31 devstack sudo[101224]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.info" returned: 0 in 0.282s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.593s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d7452c01-8837-48cb-a30c-1c7a92d58271 tempest-SnapshotMetadataTestJSON-1678533905 None] Create snapshot completed successfully Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "cinder-1031f6a2-b317-4a1e-b8f1-20ee6d38d137-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-1031f6a2-b317-4a1e-b8f1-20ee6d38d137-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "cinder-quobyte-b1161769-79b2-438e-8c1b-13af71e514d6" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-quobyte-b1161769-79b2-438e-8c1b-13af71e514d6" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "cinder-quobyte-1031f6a2-b317-4a1e-b8f1-20ee6d38d137" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-quobyte-1031f6a2-b317-4a1e-b8f1-20ee6d38d137" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Deleting offline snapshot 1031f6a2-b317-4a1e-b8f1-20ee6d38d137 of volume b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] snapshot_file for this snap is: volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f6c1f2b-dff5-4b8e-a2c2-b4d523850b95]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:33 devstack sudo[101228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 Sep 03 12:04:33 devstack sudo[101228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:33 devstack sudo[101228]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137" returned: 0 in 0.392s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1161769-79b2-438e-8c1b-13af71e514d6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:33 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc7c2fd6-bb5f-4289-af73-6c9f1ac49204]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:33 devstack sudo[101233]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 Sep 03 12:04:33 devstack sudo[101233]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:33 devstack sudo[101233]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6" returned: 0 in 0.558s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:33 devstack sudo[101240]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 Sep 03 12:04:33 devstack sudo[101240]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:34 devstack sudo[101240]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137" returned: 0 in 0.396s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:34 devstack sudo[101245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137 Sep 03 12:04:34 devstack sudo[101245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:34 devstack sudo[101245]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6.1031f6a2-b317-4a1e-b8f1-20ee6d38d137" returned: 0 in 0.316s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-quobyte-1031f6a2-b317-4a1e-b8f1-20ee6d38d137" released by "_delete_snapshot" :: held 1.800s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-quobyte-b1161769-79b2-438e-8c1b-13af71e514d6" released by "delete_snapshot" :: held 1.828s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:34 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Created reservations ['280b25de-5243-457d-a571-9af996be35b5', 'e42aab35-47f7-4893-a72c-553067fc4c3c', '6dfe56a5-41ed-47bf-a46b-796d37536a41', '146c64e6-8911-4d28-a9ea-2df038207d8a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Delete snapshot completed successfully. Sep 03 12:04:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-49b77a22-cb2d-41cc-a675-079fe28ca3e6 tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-1031f6a2-b317-4a1e-b8f1-20ee6d38d137-delete_snapshot" released by "delete_snapshot" :: held 1.991s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "cinder-b1161769-79b2-438e-8c1b-13af71e514d6-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-b1161769-79b2-438e-8c1b-13af71e514d6-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "cinder-quobyte-b1161769-79b2-438e-8c1b-13af71e514d6" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-quobyte-b1161769-79b2-438e-8c1b-13af71e514d6" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6da32493-d626-4782-93c8-c802991570c7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:35 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 Sep 03 12:04:35 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:35 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6" returned: 0 in 0.416s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:35 devstack sudo[101254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6 Sep 03 12:04:35 devstack sudo[101254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:35 devstack sudo[101254]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b1161769-79b2-438e-8c1b-13af71e514d6" returned: 0 in 0.266s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-quobyte-b1161769-79b2-438e-8c1b-13af71e514d6" released by "delete_volume" :: held 0.781s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Created reservations ['a9a5b3b3-97f6-4e49-bd6d-d80faec00a2c', '04bf0104-b5ba-4d8e-8437-6add0769c7d1', 'db7c4faf-48b5-4fd4-afd0-c64d87d8cd35', '772bde6f-8c50-468a-8efd-39ea726178de'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:36 devstack sudo[101257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:36 devstack sudo[101257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:36 devstack sudo[101257]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.351s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Deleted volume successfully. Sep 03 12:04:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5230c6a2-cf97-4afd-880a-1ecc8a18551d tempest-SnapshotMetadataTestJSON-1678533905 None] Lock "cinder-b1161769-79b2-438e-8c1b-13af71e514d6-delete_volume" released by "delete_volume" :: held 1.371s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Flow 'volume_create_manager' (bd2e863d-3063-4b16-9443-c820cc06ff52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3358834b-875e-4576-b8b0-c4049cbd691f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3358834b-875e-4576-b8b0-c4049cbd691f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1655561403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dd61ae-436f-4bb2-81d7-b18772424de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c79d09684bf45abb801e4dcd38e6496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:43Z,use_quota=True,user_id='e9c3c3121ae741cea545d68300c8c3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a018828-1b4a-4b0f-84ea-1484111bd51c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a018828-1b4a-4b0f-84ea-1484111bd51c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3899c2-9ff0-4d2a-8a69-e984a340a30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1f3899c2-9ff0-4d2a-8a69-e984a340a30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9dd61ae-436f-4bb2-81d7-b18772424de5', 'volume_name': 'volume-b9dd61ae-436f-4bb2-81d7-b18772424de5', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4405f0-3fbf-448b-891f-610c04d36e4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4405f0-3fbf-448b-891f-610c04d36e4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c992927-9216-4a56-89e9-2371d2c692ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:42 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Volume b9dd61ae-436f-4bb2-81d7-b18772424de5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9dd61ae-436f-4bb2-81d7-b18772424de5', 'volume_size': 1} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1655561403',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9dd61ae-436f-4bb2-81d7-b18772424de5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c79d09684bf45abb801e4dcd38e6496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:43Z,use_quota=True,user_id='e9c3c3121ae741cea545d68300c8c3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Creating volume b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:42 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:42 devstack sudo[101277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 1073741824 Sep 03 12:04:42 devstack sudo[101277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:43 devstack sudo[101277]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 1073741824" returned: 0 in 0.650s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:43 devstack sudo[101283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 Sep 03 12:04:43 devstack sudo[101283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:43 devstack sudo[101283]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5" returned: 0 in 0.365s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] <== create_volume: return (1076ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.079s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=88,cinder:INSERT=26,cinder:UPDATE=103,cinder:DELETE=6 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4c992927-9216-4a56-89e9-2371d2c692ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9dd61ae-436f-4bb2-81d7-b18772424de5', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9003719e-f278-4a2b-a082-acf309209702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:43 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Volume volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 (b9dd61ae-436f-4bb2-81d7-b18772424de5): created successfully Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9003719e-f278-4a2b-a082-acf309209702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:43 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Flow 'volume_create_manager' (bd2e863d-3063-4b16-9443-c820cc06ff52) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ae2f04d8-4746-4243-9644-98f2af5e9be6 tempest-VolumesDeleteCascade-722903824 None] Created volume successfully. Sep 03 12:04:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Creating offline snapshot b28c0d1c-48bd-48e2-a868-2db8b19a6c33 of volume b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:04:45 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c15d359-5e16-4951-9cbd-b761ba4c906b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:45 devstack sudo[101287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 Sep 03 12:04:45 devstack sudo[101287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:45 devstack sudo[101287]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5" returned: 0 in 0.453s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:45 devstack sudo[101293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 1G Sep 03 12:04:45 devstack sudo[101293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:46 devstack sudo[101293]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 1G" returned: 0 in 0.533s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:46 devstack sudo[101299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 Sep 03 12:04:46 devstack sudo[101299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:46 devstack sudo[101299]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33" returned: 0 in 0.336s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:46 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 is being set with open permissions: ugo+rw Sep 03 12:04:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:46 devstack sudo[101305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 Sep 03 12:04:46 devstack sudo[101305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:46 devstack sudo[101305]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33" returned: 0 in 0.290s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:46 devstack sudo[101308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.info Sep 03 12:04:46 devstack sudo[101308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:47 devstack sudo[101308]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.info" returned: 0 in 0.324s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:47 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.info is being set with open permissions: ugo+rw Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:47 devstack sudo[101311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.info Sep 03 12:04:47 devstack sudo[101311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Flow 'volume_create_manager' (7f5421a1-f9fa-4dff-93c2-6e3b89cf5a43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fa9d93-b3f2-4957-98f9-7e93a5374bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (05fa9d93-b3f2-4957-98f9-7e93a5374bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2072584566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc412e6-8587-4625-bab3-3d5332453b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b731f1a9caf64cc39f746f1a3d997c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:47Z,use_quota=True,user_id='5f0d9d20a44c4ae4bb311f36ddd91c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b123b35-eb02-458a-b116-9aea7e2c9f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b123b35-eb02-458a-b116-9aea7e2c9f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02a34d8-a672-48f4-9a3d-0df8580352a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:04:47 devstack sudo[101311]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.info" returned: 0 in 0.316s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.378s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (f52dc84a-029e-4e7a-ad03-28d97edd1f61) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aeca772-1c6b-4972-a1b1-78be87a5c86b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9aeca772-1c6b-4972-a1b1-78be87a5c86b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137363270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:47Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4604e6fa-8852-4d12-b905-8bbb32e724a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4604e6fa-8852-4d12-b905-8bbb32e724a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379535ef-dc42-4f20-9ff1-a6b8f357177f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (379535ef-dc42-4f20-9ff1-a6b8f357177f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa', 'volume_name': 'volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecfc43a-6cbd-4282-be4b-6eab1303df41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ecfc43a-6cbd-4282-be4b-6eab1303df41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd8b06e-40e6-42fc-a64a-5118dae47c1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Volume f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa', 'volume_size': 1} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2137363270',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:47Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Creating volume f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:47 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:47 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-44ffaa6a-abf2-433b-aaac-7563dfb9fd9e tempest-VolumesDeleteCascade-722903824 None] Create snapshot completed successfully Sep 03 12:04:47 devstack sudo[101314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa 1073741824 Sep 03 12:04:47 devstack sudo[101314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a02a34d8-a672-48f4-9a3d-0df8580352a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7dc412e6-8587-4625-bab3-3d5332453b4b', 'volume_name': 'volume-7dc412e6-8587-4625-bab3-3d5332453b4b', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce66b979-9630-4862-b7d1-5807e5289dac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce66b979-9630-4862-b7d1-5807e5289dac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdecb736-a3a8-4b32-9db0-3398b0f462ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Volume 7dc412e6-8587-4625-bab3-3d5332453b4b: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7dc412e6-8587-4625-bab3-3d5332453b4b', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Trying to clone 7dc412e6-8587-4625-bab3-3d5332453b4b from image b9f83e66-733e-4378-86ef-e85be0416fc2 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (ca04168b-d0a8-4b8a-b52a-fc994b290e8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c57151-0fc0-445a-ad95-f3b920903c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a9c57151-0fc0-445a-ad95-f3b920903c39) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432276340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d247ad-5814-4756-9e39-2aacfcb87154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:48Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808ba60c-6151-4335-92f3-180edfcbc005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (808ba60c-6151-4335-92f3-180edfcbc005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fba253-d450-4508-a8e6-33c30025ffba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46fba253-d450-4508-a8e6-33c30025ffba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c2d247ad-5814-4756-9e39-2aacfcb87154', 'volume_name': 'volume-c2d247ad-5814-4756-9e39-2aacfcb87154', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa933bb5-6538-4d83-8f13-ff043ef83e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aa933bb5-6538-4d83-8f13-ff043ef83e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183c21ba-1f94-4753-af35-113661e1dfc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Volume c2d247ad-5814-4756-9e39-2aacfcb87154: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c2d247ad-5814-4756-9e39-2aacfcb87154', 'volume_size': 1} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:48 devstack sudo[101314]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa 1073741824" returned: 0 in 0.653s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:04:48 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Image download 20.69 MB at 20.69 MB/s Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:48 devstack sudo[101321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa Sep 03 12:04:48 devstack sudo[101321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa8e5b07-4457-49e0-bd68-a35f60a4079d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (7b3c41ef-a8b7-4128-821b-444b250cef16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca4af65-f5e4-4618-bb45-0d172aafe37b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca4af65-f5e4-4618-bb45-0d172aafe37b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543892984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10452c8-f008-447a-bfa9-938dc92d3863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:48Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5883f95-4cc5-4987-9b65-00b746c3dc17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e5883f95-4cc5-4987-9b65-00b746c3dc17) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a165b319-cfa1-4e47-ace6-f5f68eecb9a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a165b319-cfa1-4e47-ace6-f5f68eecb9a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f10452c8-f008-447a-bfa9-938dc92d3863', 'volume_name': 'volume-f10452c8-f008-447a-bfa9-938dc92d3863', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fe9d59-1922-424c-b81c-25b5b28abfa4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19fe9d59-1922-424c-b81c-25b5b28abfa4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca0f68d-15c6-453c-99d6-49b59bbaf950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Volume f10452c8-f008-447a-bfa9-938dc92d3863: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f10452c8-f008-447a-bfa9-938dc92d3863', 'volume_size': 1} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:48 devstack sudo[101323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD Sep 03 12:04:48 devstack sudo[101323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:48 devstack sudo[101321]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa" returned: 0 in 0.438s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] <== create_volume: return (1215ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.218s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.813s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1432276340',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c2d247ad-5814-4756-9e39-2aacfcb87154,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:48Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Creating volume c2d247ad-5814-4756-9e39-2aacfcb87154 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:48 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9fd8b06e-40e6-42fc-a64a-5118dae47c1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack sudo[101326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 1073741824 Sep 03 12:04:48 devstack sudo[101326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424aeeaa-08d6-4123-b563-979c2f6cfed0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:48 devstack sudo[101323]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD" returned: 0 in 0.450s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 is fetched for user 5f0d9d20a44c4ae4bb311f36ddd91c1b. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:04:48 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Volume volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa (f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa): created successfully Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (424aeeaa-08d6-4123-b563-979c2f6cfed0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (f52dc84a-029e-4e7a-ad03-28d97edd1f61) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-47eca38f-23b4-4a85-9510-4cb7d6287029 tempest-CreateVolumesFromImageTest-3159154 None] Created volume successfully. Sep 03 12:04:48 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (ad585b1c-bbe0-4931-aa21-3b0387830d37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4e34e7-766c-4d51-b2b0-b9e6c87f5289) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7e4e34e7-766c-4d51-b2b0-b9e6c87f5289) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452548757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:49Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8592184-e994-4ab2-90e0-8de78d16af99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8592184-e994-4ab2-90e0-8de78d16af99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da77e30-b033-42e9-9225-237c7e64b445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0da77e30-b033-42e9-9225-237c7e64b445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f', 'volume_name': 'volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c27f13-527a-4fb7-8956-d6b0c0dbbfc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96c27f13-527a-4fb7-8956-d6b0c0dbbfc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19090def-6ee3-4209-8a5c-e4a4ca3e6788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Volume 5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f', 'volume_size': 1} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[95cf0567-a08e-44de-bf57-2788a7132786]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:49 devstack sudo[101332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD Sep 03 12:04:49 devstack sudo[101332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (d2126741-cd35-4e83-9bd1-bf1c4cd1a59a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398a64b5-88ec-4949-9d1e-700a916a8608) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack sudo[101326]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (398a64b5-88ec-4949-9d1e-700a916a8608) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446288993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde230a4-e50d-4986-8063-22e47a2e7fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:49Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c1a72d-68e3-45e2-84b5-a74e95f95179) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57c1a72d-68e3-45e2-84b5-a74e95f95179) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44927f3-ac71-4a1a-b98d-66e10d451fde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e44927f3-ac71-4a1a-b98d-66e10d451fde) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dde230a4-e50d-4986-8063-22e47a2e7fc8', 'volume_name': 'volume-dde230a4-e50d-4986-8063-22e47a2e7fc8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b13ed6-823f-4a68-8f20-a31748c8074f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b13ed6-823f-4a68-8f20-a31748c8074f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8081f9d-f087-44e4-be19-c8886947f77e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Volume dde230a4-e50d-4986-8063-22e47a2e7fc8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dde230a4-e50d-4986-8063-22e47a2e7fc8', 'volume_size': 1} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 1073741824" returned: 0 in 0.601s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:49 devstack sudo[101332]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD" returned: 0 in 0.391s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:49 devstack sudo[101341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 Sep 03 12:04:49 devstack sudo[101341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:49 devstack sudo[101341]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] <== create_volume: return (895ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.139s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-543892984',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f10452c8-f008-447a-bfa9-938dc92d3863,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:48Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Creating volume f10452c8-f008-447a-bfa9-938dc92d3863 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:49 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (183c21ba-1f94-4753-af35-113661e1dfc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c2d247ad-5814-4756-9e39-2aacfcb87154', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack sudo[101344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 1073741824 Sep 03 12:04:49 devstack sudo[101344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b767ed17-df47-496b-8dc6-72c14aac5c01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Volume volume-c2d247ad-5814-4756-9e39-2aacfcb87154 (c2d247ad-5814-4756-9e39-2aacfcb87154): created successfully Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b767ed17-df47-496b-8dc6-72c14aac5c01) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (ca04168b-d0a8-4b8a-b52a-fc994b290e8f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:49 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-eec014c0-77b8-4f49-937a-a8b594356602 tempest-CreateVolumesFromImageTest-3159154 None] Created volume successfully. Sep 03 12:04:50 devstack sudo[101344]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 1073741824" returned: 0 in 0.407s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:50 devstack sudo[101350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 Sep 03 12:04:50 devstack sudo[101350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:50 devstack sudo[101350]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863" returned: 0 in 0.253s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.703s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.715s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Creating offline snapshot 87645427-2c2a-4268-856c-5f2d93f6eaaf of volume b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fca0f68d-15c6-453c-99d6-49b59bbaf950) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f10452c8-f008-447a-bfa9-938dc92d3863', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1879d82e-0be3-4ee6-a965-1dc4d253fad4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f24cb023-1099-4598-aae5-746b90a1138f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Volume volume-f10452c8-f008-447a-bfa9-938dc92d3863 (f10452c8-f008-447a-bfa9-938dc92d3863): created successfully Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1879d82e-0be3-4ee6-a965-1dc4d253fad4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (7b3c41ef-a8b7-4128-821b-444b250cef16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3e1d4958-6a48-4fb6-b3a1-1c2e2491a447 tempest-CreateVolumesFromImageTest-3159154 None] Created volume successfully. Sep 03 12:04:50 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 Sep 03 12:04:50 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:50 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33" returned: 0 in 0.360s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9dd61ae-436f-4bb2-81d7-b18772424de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:50 devstack sudo[101358]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf 1G Sep 03 12:04:50 devstack sudo[101358]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:51 devstack sudo[101358]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf 1G" returned: 0 in 0.398s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:51 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf Sep 03 12:04:51 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:51 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf" returned: 0 in 0.283s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:51 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf is being set with open permissions: ugo+rw Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:51 devstack sudo[101369]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf Sep 03 12:04:51 devstack sudo[101369]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:51 devstack sudo[101369]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.386s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.734s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-452548757',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:49Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Creating volume 5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:51 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:51 devstack sudo[101372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f 1073741824 Sep 03 12:04:51 devstack sudo[101372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-abbf8ce2-1b4b-4570-abc1-67b3b6d361c6 tempest-VolumesDeleteCascade-722903824 None] Create snapshot completed successfully Sep 03 12:04:52 devstack sudo[101372]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f 1073741824" returned: 0 in 0.411s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:52 devstack sudo[101377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f Sep 03 12:04:52 devstack sudo[101377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:52 devstack sudo[101377]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] <== create_volume: return (700ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.702s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-446288993',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dde230a4-e50d-4986-8063-22e47a2e7fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='da63f9cd680d4767ac5a22ed16041306',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:49Z,use_quota=True,user_id='ad5748d5e3864a91aaea05fed9b10068',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Creating volume dde230a4-e50d-4986-8063-22e47a2e7fc8 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:52 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:52 devstack sudo[101380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 1073741824 Sep 03 12:04:52 devstack sudo[101380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (19090def-6ee3-4209-8a5c-e4a4ca3e6788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79af9eda-bcdf-4b0b-bb8e-1bc827ab2742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:52 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Volume volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f (5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f): created successfully Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79af9eda-bcdf-4b0b-bb8e-1bc827ab2742) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (ad585b1c-bbe0-4931-aa21-3b0387830d37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-86472ead-1bb1-46ba-a19f-09b16ed99adb tempest-CreateVolumesFromImageTest-3159154 None] Created volume successfully. Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-b9dd61ae-436f-4bb2-81d7-b18772424de5-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-b9dd61ae-436f-4bb2-81d7-b18772424de5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Performing cascade delete. {{(pid=87256) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 12:04:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-87645427-2c2a-4268-856c-5f2d93f6eaaf-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:53 devstack sudo[101380]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-87645427-2c2a-4268-856c-5f2d93f6eaaf-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 1073741824" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-87645427-2c2a-4268-856c-5f2d93f6eaaf" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-87645427-2c2a-4268-856c-5f2d93f6eaaf" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Deleting offline snapshot 87645427-2c2a-4268-856c-5f2d93f6eaaf of volume b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:04:53 devstack sudo[101386]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 Sep 03 12:04:53 devstack sudo[101386]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] snapshot_file for this snap is: volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[961d5d20-5526-4086-91c9-37df0d0ea797]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:53 devstack sudo[101388]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf Sep 03 12:04:53 devstack sudo[101388]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:53 devstack sudo[101386]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8" returned: 0 in 0.265s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.797s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.832s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:04:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-2072584566',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7dc412e6-8587-4625-bab3-3d5332453b4b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b731f1a9caf64cc39f746f1a3d997c5a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:04:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:04:47Z,use_quota=True,user_id='5f0d9d20a44c4ae4bb311f36ddd91c1b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Creating volume 7dc412e6-8587-4625-bab3-3d5332453b4b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:04:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8081f9d-f087-44e4-be19-c8886947f77e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dde230a4-e50d-4986-8063-22e47a2e7fc8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:53 devstack sudo[101393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b 1073741824 Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145c5658-d727-4a75-9805-8861b8d9d43b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:53 devstack sudo[101393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Volume volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 (dde230a4-e50d-4986-8063-22e47a2e7fc8): created successfully Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (145c5658-d727-4a75-9805-8861b8d9d43b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Flow 'volume_create_manager' (d2126741-cd35-4e83-9bd1-bf1c4cd1a59a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:53 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bc4f63fa-a535-44db-af6d-c0d79c4ba217 tempest-CreateVolumesFromImageTest-3159154 None] Created volume successfully. Sep 03 12:04:53 devstack sudo[101388]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf" returned: 0 in 0.455s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9dd61ae-436f-4bb2-81d7-b18772424de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b399efb0-9559-45c1-92ff-108cb6a755b0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:53 devstack sudo[101402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 Sep 03 12:04:53 devstack sudo[101402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-dde230a4-e50d-4986-8063-22e47a2e7fc8-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-dde230a4-e50d-4986-8063-22e47a2e7fc8-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-quobyte-dde230a4-e50d-4986-8063-22e47a2e7fc8" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:53 devstack sudo[101393]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b 1073741824" returned: 0 in 0.607s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-dde230a4-e50d-4986-8063-22e47a2e7fc8" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[33eae031-23f0-4214-a668-e78ccfbcb683]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:54 devstack sudo[101413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b Sep 03 12:04:54 devstack sudo[101413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:54 devstack sudo[101402]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33" returned: 0 in 0.521s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9dd61ae-436f-4bb2-81d7-b18772424de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:54 devstack sudo[101409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 Sep 03 12:04:54 devstack sudo[101409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:54 devstack sudo[101415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf Sep 03 12:04:54 devstack sudo[101415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:54 devstack sudo[101413]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b" returned: 0 in 0.328s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] <== create_volume: return (1026ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.029s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Attempting download of b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume 7dc412e6-8587-4625-bab3-3d5332453b4b. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f5ab6e0-debf-44c5-a21a-1dc011455ae9]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_hrb5pr6j {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:54 devstack sudo[101409]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8" returned: 0 in 0.503s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:54 devstack sudo[101426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8 Sep 03 12:04:54 devstack sudo[101426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:54 devstack sudo[101425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_hrb5pr6j Sep 03 12:04:54 devstack sudo[101425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:54 devstack sudo[101415]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf" returned: 0 in 0.525s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:54 devstack sudo[101430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf Sep 03 12:04:54 devstack sudo[101430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:54 devstack sudo[101426]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dde230a4-e50d-4986-8063-22e47a2e7fc8" returned: 0 in 0.312s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-dde230a4-e50d-4986-8063-22e47a2e7fc8" released by "delete_volume" :: held 0.870s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:54 devstack sudo[101425]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_hrb5pr6j" returned: 0 in 0.430s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_hrb5pr6j {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:54 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Created reservations ['b71e1c70-546a-4a7c-9712-31122306a5da', 'b3afc495-9ce5-43d1-9ca7-c55c1311bffa', '2851e7e3-dd5c-4402-87a7-322a43cfb03c', '177c38be-f48b-4522-b17a-364b8d368ef5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:55 devstack sudo[101430]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.87645427-2c2a-4268-856c-5f2d93f6eaaf" returned: 0 in 0.434s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:55 devstack sudo[101436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_hrb5pr6j Sep 03 12:04:55 devstack sudo[101436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:55 devstack sudo[101438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:55 devstack sudo[101438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-87645427-2c2a-4268-856c-5f2d93f6eaaf" released by "_delete_snapshot" :: held 2.125s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" released by "delete_snapshot" :: held 2.177s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f-delete_volume" acquired by "delete_volume" :: waited 0.115s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-quobyte-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Created reservations ['b89a0702-53c8-4a49-92a1-169a49fe6ccd', '5ae3ed99-c2fb-42c1-944a-cd5410767f86', '7fa4b9df-443c-4247-9df5-4c9c71e7a525', 'eb7c3c36-0964-4e3d-b23e-cf96dc36b791'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[75478208-5a00-4595-98ac-978c3f9fda77]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:55 devstack sudo[101438]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.417s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Deleted volume successfully. Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dc985851-af62-4e13-ac50-e20eba9bc7cd tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-dde230a4-e50d-4986-8063-22e47a2e7fc8-delete_volume" released by "delete_volume" :: held 1.671s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Delete snapshot completed successfully. Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-87645427-2c2a-4268-856c-5f2d93f6eaaf-delete_snapshot" released by "delete_snapshot" :: held 2.540s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-b28c0d1c-48bd-48e2-a868-2db8b19a6c33-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:55 devstack sudo[101436]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-b28c0d1c-48bd-48e2-a868-2db8b19a6c33-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_hrb5pr6j" returned: 1 in 0.676s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b9f83e66-733e-4378-86ef-e85be0416fc2_hrb5pr6j' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f577ad0-d9af-4cac-b428-4e38ccfc6f4b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-b28c0d1c-48bd-48e2-a868-2db8b19a6c33" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b28c0d1c-48bd-48e2-a868-2db8b19a6c33" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Deleting offline snapshot b28c0d1c-48bd-48e2-a868-2db8b19a6c33 of volume b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:04:55 devstack sudo[101442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f Sep 03 12:04:55 devstack sudo[101442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] snapshot_file for this snap is: volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8a3e256a-d921-44a5-a256-034302039ac8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:55 devstack sudo[101445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD Sep 03 12:04:55 devstack sudo[101445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:55 devstack sudo[101447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 Sep 03 12:04:55 devstack sudo[101447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:56 devstack sudo[101442]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f" returned: 0 in 0.589s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:56 devstack sudo[101445]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD" returned: 0 in 0.483s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] b9f83e66-733e-4378-86ef-e85be0416fc2 was qcow2, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:56 devstack sudo[101457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f Sep 03 12:04:56 devstack sudo[101457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:56 devstack sudo[101458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b Sep 03 12:04:56 devstack sudo[101458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:56 devstack sudo[101447]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33" returned: 0 in 0.475s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9dd61ae-436f-4bb2-81d7-b18772424de5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd0fd67d-581b-4a30-9cce-928e0d1292a4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:56 devstack sudo[101457]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f" returned: 0 in 0.382s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f" released by "delete_volume" :: held 1.038s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:56 devstack sudo[101466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 Sep 03 12:04:56 devstack sudo[101466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Created reservations ['823449da-cd6a-49ef-b70c-ec7d9404b6cf', '7159fac4-03df-4a19-9f27-fdd35cc635fd', '2c33e496-4482-4562-a527-871fff1be3d9', '2705f611-da01-4b19-a402-a1f782aff442'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:56 devstack sudo[101474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:56 devstack sudo[101474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:56 devstack sudo[101466]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5" returned: 0 in 0.665s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:56 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 Sep 03 12:04:56 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:57 devstack sudo[101474]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.415s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Deleted volume successfully. Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a7fc6b6-3475-477e-b7b8-f7e4acde7697 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-5a36a5a7-c659-4ff8-ab4b-b05d645b5a7f-delete_volume" released by "delete_volume" :: held 1.800s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-ae3d9a5c-805d-495d-b06d-9f3cbb665a18 req-ea40b456-1ee7-4c59-8ed8-e6242a517610 tempest-TestMinimumBasicScenario-1566718723 None] Terminate volume connection completed successfully. Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-ae3d9a5c-805d-495d-b06d-9f3cbb665a18 req-ea40b456-1ee7-4c59-8ed8-e6242a517610 tempest-TestMinimumBasicScenario-1566718723 None] Deleting attachment 4f9fef45-ae4d-4de5-b465-797ac8349a9e. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:04:57 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33" returned: 0 in 0.544s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:57 devstack sudo[101496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33 Sep 03 12:04:57 devstack sudo[101496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-f10452c8-f008-447a-bfa9-938dc92d3863-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-f10452c8-f008-447a-bfa9-938dc92d3863-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-quobyte-f10452c8-f008-447a-bfa9-938dc92d3863" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-f10452c8-f008-447a-bfa9-938dc92d3863" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9906bc66-816f-4952-8e61-074cb3ee49aa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:57 devstack sudo[101496]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5.b28c0d1c-48bd-48e2-a868-2db8b19a6c33" returned: 0 in 0.307s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:57 devstack sudo[101498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 Sep 03 12:04:57 devstack sudo[101498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b28c0d1c-48bd-48e2-a868-2db8b19a6c33" released by "_delete_snapshot" :: held 2.143s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" released by "delete_snapshot" :: held 2.181s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:57 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Created reservations ['03d5d77d-1555-4dbd-bf5d-174d36806359', '36568ea9-7d82-48eb-9662-9ab1c3dabb70', '4b984917-80eb-4bfe-8c3f-031992e1dd82', '373b3f46-2e6e-43f4-b09b-c9349157e8e1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Delete snapshot completed successfully. Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-b28c0d1c-48bd-48e2-a868-2db8b19a6c33-delete_snapshot" released by "delete_snapshot" :: held 2.434s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Snapshots deleted, issuing volume delete {{(pid=87256) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0647d9d6-69b4-460c-bd29-2b596cf08ffa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack sudo[101498]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863" returned: 0 in 0.478s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Acquiring lock "cinder-94697822-f845-4bfd-9486-d645fe83b64f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:58 devstack sudo[101505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863 Sep 03 12:04:58 devstack sudo[101505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Lock "cinder-94697822-f845-4bfd-9486-d645fe83b64f-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:58 devstack sudo[101503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 Sep 03 12:04:58 devstack sudo[101503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Acquiring lock "cinder-quobyte-94697822-f845-4bfd-9486-d645fe83b64f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Lock "cinder-quobyte-94697822-f845-4bfd-9486-d645fe83b64f" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2f7cd32-8728-44f9-b0fd-65298a7cec99]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack sudo[101458]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:58 devstack sudo[101508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f Sep 03 12:04:58 devstack sudo[101508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b" returned: 0 in 2.379s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b9f83e66-733e-4378-86ef-e85be0416fc2_1mccpb8ydevstack@QuobyteHD, size 112.00 MB, duration 2.38 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:04:58 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Converted 112.00 MB image at 47.04 MB/s Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b 1G Sep 03 12:04:58 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:58 devstack sudo[101505]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f10452c8-f008-447a-bfa9-938dc92d3863" returned: 0 in 0.332s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-f10452c8-f008-447a-bfa9-938dc92d3863" released by "delete_volume" :: held 0.854s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:58 devstack sudo[101503]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5" returned: 0 in 0.494s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack sudo[101516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5 Sep 03 12:04:58 devstack sudo[101516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Created reservations ['dc6c7abe-8a1d-43bf-9ad6-a505632040c3', '84ae8973-0840-4e1f-853f-19eeeb0e410e', '881f5016-05ec-4924-9a2a-e66608c95d85', '4e48a18f-cda0-468b-af98-68ce71b29648'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack sudo[101521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:58 devstack sudo[101521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:58 devstack sudo[101508]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f" returned: 0 in 0.451s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack sudo[101525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f Sep 03 12:04:58 devstack sudo[101525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-c2d247ad-5814-4756-9e39-2aacfcb87154-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-c2d247ad-5814-4756-9e39-2aacfcb87154-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-quobyte-c2d247ad-5814-4756-9e39-2aacfcb87154" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-c2d247ad-5814-4756-9e39-2aacfcb87154" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:04:58 devstack sudo[101516]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9dd61ae-436f-4bb2-81d7-b18772424de5" returned: 0 in 0.363s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9bbd123f-4741-4c2e-a109-a598ddbb2f8f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:58 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b 1G" returned: 0 in 0.523s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Downloaded image b9f83e66-733e-4378-86ef-e85be0416fc2 ((None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}])) to volume 7dc412e6-8587-4625-bab3-3d5332453b4b successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Temporary image b9f83e66-733e-4378-86ef-e85be0416fc2 for user 5f0d9d20a44c4ae4bb311f36ddd91c1b is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:04:58 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Marking volume 7dc412e6-8587-4625-bab3-3d5332453b4b as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-b9dd61ae-436f-4bb2-81d7-b18772424de5" released by "delete_volume" :: held 0.964s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Copying metadata from image b9f83e66-733e-4378-86ef-e85be0416fc2 to 7dc412e6-8587-4625-bab3-3d5332453b4b. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Creating volume glance metadata for volume 7dc412e6-8587-4625-bab3-3d5332453b4b backed by image b9f83e66-733e-4378-86ef-e85be0416fc2 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Created reservations ['8577fa06-9bbf-402d-94dd-0a43cb37531f', '44061ab8-5289-42b1-a715-71171e35ede0', 'bd4624af-ceb1-4d56-a20b-1339392a9d07', '61879c0f-b16f-4022-a28a-27f9a802ea45'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:59 devstack sudo[101525]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:59 devstack sudo[101531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-94697822-f845-4bfd-9486-d645fe83b64f" returned: 0 in 0.405s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:59 devstack sudo[101531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bdecb736-a3a8-4b32-9db0-3398b0f462ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7dc412e6-8587-4625-bab3-3d5332453b4b', 'volume_size': 1, 'image_id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b9f83e66-733e-4378-86ef-e85be0416fc2', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'ca151b71e145428a9dac0c5f77cb62e7', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'b9f83e66-733e-4378-86ef-e85be0416fc2', 'created_at': datetime.datetime(2026, 9, 3, 9, 45, 52, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 9, 45, 54, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b9f83e66-733e-4378-86ef-e85be0416fc2/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25682658-b0f5-4ae2-a80c-d0984b699e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:04:59 devstack sudo[101521]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.489s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Lock "cinder-quobyte-94697822-f845-4bfd-9486-d645fe83b64f" released by "delete_volume" :: held 0.919s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Deleted volume successfully. Sep 03 12:04:59 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Volume volume-7dc412e6-8587-4625-bab3-3d5332453b4b (7dc412e6-8587-4625-bab3-3d5332453b4b): created successfully Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (25682658-b0f5-4ae2-a80c-d0984b699e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Flow 'volume_create_manager' (7f5421a1-f9fa-4dff-93c2-6e3b89cf5a43) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9847e685-37f8-4d08-8139-87c514a28862 tempest-TestShelveInstance-1166583260 None] Created volume successfully. Sep 03 12:04:59 devstack sudo[101535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:59 devstack sudo[101535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-034c1ef0-29ac-4182-bd9e-c463f20b19eb tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-f10452c8-f008-447a-bfa9-938dc92d3863-delete_volume" released by "delete_volume" :: held 1.778s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Created reservations ['db151a64-229f-486b-962d-514ae8eebdc0', '293067f0-2594-45d4-9c9b-598fbb10d08d', '1500ecc5-1b01-416d-b26b-8bfaaacba921', '94473199-940b-47cd-85e0-918cee9e19ba'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:59 devstack sudo[101531]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154" returned: 0 in 0.529s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:59 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:59 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:59 devstack sudo[101543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154 Sep 03 12:04:59 devstack sudo[101543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:04:59 devstack sudo[101535]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.293s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Deleted volume successfully. Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a826dac-6d00-472b-9975-549caca01a28 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-b9dd61ae-436f-4bb2-81d7-b18772424de5-delete_volume" released by "delete_volume" :: held 6.714s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:59 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.275s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:04:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Deleted volume successfully. Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4a15e253-cb34-4f1e-aad4-f3aae0087fb4 tempest-TestMinimumBasicScenario-1566718723 None] Lock "cinder-94697822-f845-4bfd-9486-d645fe83b64f-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:59 devstack sudo[101543]: pam_unix(sudo:session): session closed for user root Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c2d247ad-5814-4756-9e39-2aacfcb87154" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-c2d247ad-5814-4756-9e39-2aacfcb87154" released by "delete_volume" :: held 0.882s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Created reservations ['ff33986e-8007-496b-ae7e-9b9bff04cac3', '912b3d44-487b-4623-bec4-6e947052e704', '1d5bab37-0c30-412a-9095-ab545c61d8c7', '3bb94486-a00d-49ff-a17a-82bdc9d6d245'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:04:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:04:59 devstack sudo[101548]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:04:59 devstack sudo[101548]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "cinder-quobyte-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[47366d5c-f7d4-4cd4-a292-8b438112ffb3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:00 devstack sudo[101548]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.311s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Deleted volume successfully. Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d346203e-ba9e-4b76-8a9d-d2da179a391d tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-c2d247ad-5814-4756-9e39-2aacfcb87154-delete_volume" released by "delete_volume" :: held 1.447s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:00 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa Sep 03 12:05:00 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Flow 'volume_create_manager' (ef031569-5ad8-481b-b6dc-3899ad3f19ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33213f67-ba09-4a00-96ae-00c9cd9e6005) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (33213f67-ba09-4a00-96ae-00c9cd9e6005) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2030305575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bf01d7-907f-4ac5-9f40-1f1cac6f774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c79d09684bf45abb801e4dcd38e6496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:00Z,use_quota=True,user_id='e9c3c3121ae741cea545d68300c8c3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dede45b-3aca-4213-aecc-8b6eda6a28d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6dede45b-3aca-4213-aecc-8b6eda6a28d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da612cd5-b1b7-4115-a96d-866bd82c0992) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (da612cd5-b1b7-4115-a96d-866bd82c0992) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '18bf01d7-907f-4ac5-9f40-1f1cac6f774a', 'volume_name': 'volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f303c24-fce7-4e45-9d44-baf389ac771c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9f303c24-fce7-4e45-9d44-baf389ac771c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f685b8df-989c-42da-a7c7-7319a50dba0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Volume 18bf01d7-907f-4ac5-9f40-1f1cac6f774a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a', 'volume_size': 1} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-2030305575',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=18bf01d7-907f-4ac5-9f40-1f1cac6f774a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c79d09684bf45abb801e4dcd38e6496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:00Z,use_quota=True,user_id='e9c3c3121ae741cea545d68300c8c3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Creating volume 18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:00 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:00 devstack sudo[101553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a 1073741824 Sep 03 12:05:00 devstack sudo[101553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:00 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa" returned: 0 in 0.566s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:00 devstack sudo[101559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa Sep 03 12:05:00 devstack sudo[101559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:01 devstack sudo[101559]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa" returned: 0 in 0.406s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-quobyte-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa" released by "delete_volume" :: held 1.051s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Created reservations ['adca96bf-fd35-4778-be1c-d9efc82b196d', '1bd121c4-23a6-475b-bed9-d298810fecff', 'ee84b3e1-fff8-4b20-a598-138c7f865b94', 'f48c836d-dcd5-4934-98a8-21f4aa1483e6'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:01 devstack sudo[101553]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a 1073741824" returned: 0 in 0.778s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:01 devstack sudo[101586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:01 devstack sudo[101586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:01 devstack sudo[101590]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:01 devstack sudo[101590]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:01 devstack sudo[101586]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" returned: 0 in 0.292s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] <== create_volume: return (1137ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.140s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f685b8df-989c-42da-a7c7-7319a50dba0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca540a3f-d511-4933-ab52-a56e607af396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:01 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Volume volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a (18bf01d7-907f-4ac5-9f40-1f1cac6f774a): created successfully Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ca540a3f-d511-4933-ab52-a56e607af396) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Flow 'volume_create_manager' (ef031569-5ad8-481b-b6dc-3899ad3f19ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-281408fe-e262-42af-bef0-d7b8bc1afd1d tempest-VolumesDeleteCascade-722903824 None] Created volume successfully. Sep 03 12:05:01 devstack sudo[101590]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.412s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Deleted volume successfully. Sep 03 12:05:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f8a559da-af68-4aac-ad64-fa9e9dfd3714 tempest-CreateVolumesFromImageTest-3159154 None] Lock "cinder-f1a77fa4-a3b5-40e0-8c2e-5a925f6201fa-delete_volume" released by "delete_volume" :: held 1.860s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Creating offline snapshot d1b386bf-5829-41da-b76f-697537ee8e3d of volume 18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:05:02 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9fc408fb-f0d7-444e-9f7c-cb6c209603f2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:03 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a Sep 03 12:05:03 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:03 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" returned: 0 in 0.564s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:03 devstack sudo[101606]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d 1G Sep 03 12:05:03 devstack sudo[101606]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:04 devstack sudo[101606]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d 1G" returned: 0 in 0.732s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:04 devstack sudo[101621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d Sep 03 12:05:04 devstack sudo[101621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-09a00a26-b66d-452e-9d12-0fdb152098eb req-c1d18bba-4197-45b4-94ef-b414539f743d tempest-TestShelveInstance-1166583260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:04 devstack sudo[101621]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d" returned: 0 in 0.450s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:04 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d is being set with open permissions: ugo+rw Sep 03 12:05:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:04 devstack sudo[101627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d Sep 03 12:05:04 devstack sudo[101627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:04 devstack sudo[101627]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d" returned: 0 in 0.287s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:04 devstack sudo[101630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.info Sep 03 12:05:04 devstack sudo[101630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:05 devstack sudo[101630]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.info" returned: 0 in 0.366s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:05 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.info is being set with open permissions: ugo+rw Sep 03 12:05:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:05 devstack sudo[101633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.info Sep 03 12:05:05 devstack sudo[101633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:05 devstack sudo[101633]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.info" returned: 0 in 0.274s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.804s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-09a00a26-b66d-452e-9d12-0fdb152098eb req-c1d18bba-4197-45b4-94ef-b414539f743d tempest-TestShelveInstance-1166583260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.400s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-09a00a26-b66d-452e-9d12-0fdb152098eb req-c1d18bba-4197-45b4-94ef-b414539f743d tempest-TestShelveInstance-1166583260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5a3880d9-ae58-490d-af43-eab5bd406493 tempest-VolumesDeleteCascade-722903824 None] Create snapshot completed successfully Sep 03 12:05:05 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-09a00a26-b66d-452e-9d12-0fdb152098eb req-c1d18bba-4197-45b4-94ef-b414539f743d tempest-TestShelveInstance-1166583260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-7dc412e6-8587-4625-bab3-3d5332453b4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '0673f4a0-c069-448c-94c5-e094d419f5a2', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:05:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-09a00a26-b66d-452e-9d12-0fdb152098eb req-c1d18bba-4197-45b4-94ef-b414539f743d tempest-TestShelveInstance-1166583260 None] attachment_update completed successfully. Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (364f5bd4-47ed-4ee9-8e58-41e552000d2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb932146-f28e-4176-bba8-5f0581044713) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eb932146-f28e-4176-bba8-5f0581044713) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-176064255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7b660c-cd93-46e8-ac96-53a655ae9e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:07Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b826f48-3453-42e4-94b9-a7885a392935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b826f48-3453-42e4-94b9-a7885a392935) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e185df-4e9f-485a-b6af-b6743f921f58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a6e185df-4e9f-485a-b6af-b6743f921f58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d7b660c-cd93-46e8-ac96-53a655ae9e84', 'volume_name': 'volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964aaf32-f9da-4276-8932-3c5f59ae1b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (964aaf32-f9da-4276-8932-3c5f59ae1b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370f5f2d-15c2-4b22-8f54-5db45b70116e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume 6d7b660c-cd93-46e8-ac96-53a655ae9e84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84', 'volume_size': 1} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-176064255',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d7b660c-cd93-46e8-ac96-53a655ae9e84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:07Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Creating volume 6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:07 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:07 devstack sudo[101640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 1073741824 Sep 03 12:05:07 devstack sudo[101640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Flow 'volume_create_manager' (33fd2aa8-df61-4b18-935b-9daaa4db3965) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506b1388-2277-435d-b430-2504bf935df0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (506b1388-2277-435d-b430-2504bf935df0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-691372960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f2d93389-8279-4ad7-9f53-ae99489522df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6c79d09684bf45abb801e4dcd38e6496',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=d1b386bf-5829-41da-b76f-697537ee8e3d,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:07Z,use_quota=True,user_id='e9c3c3121ae741cea545d68300c8c3ca',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d166bc6-d995-46f0-a6fc-28f50e6a8b5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d166bc6-d995-46f0-a6fc-28f50e6a8b5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0ee96-6d85-4cee-84af-9cc346e347b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88f0ee96-6d85-4cee-84af-9cc346e347b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f2d93389-8279-4ad7-9f53-ae99489522df', 'volume_name': 'volume-f2d93389-8279-4ad7-9f53-ae99489522df', 'volume_size': 1, 'snapshot_id': 'd1b386bf-5829-41da-b76f-697537ee8e3d'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9ce366-6fc3-4251-bbfc-c59f3f484a88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a9ce366-6fc3-4251-bbfc-c59f3f484a88) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d314fae-ad64-45db-9633-e0eded9c8130) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:07 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Volume f2d93389-8279-4ad7-9f53-ae99489522df: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f2d93389-8279-4ad7-9f53-ae99489522df', 'volume_size': 1, 'snapshot_id': 'd1b386bf-5829-41da-b76f-697537ee8e3d'} Sep 03 12:05:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:08 devstack sudo[101640]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 1073741824" returned: 0 in 0.862s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:08 devstack sudo[102035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 Sep 03 12:05:08 devstack sudo[102035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:08 devstack sudo[102035]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84" returned: 0 in 0.438s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] <== create_volume: return (1411ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.414s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.104s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-d1b386bf-5829-41da-b76f-697537ee8e3d-f2d93389-8279-4ad7-9f53-ae99489522df" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (370f5f2d-15c2-4b22-8f54-5db45b70116e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64af0a14-63e3-4c9e-b4d9-8361d258f200) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-d1b386bf-5829-41da-b76f-697537ee8e3d-f2d93389-8279-4ad7-9f53-ae99489522df" acquired by "_create_volume_from_snapshot" :: waited 0.051s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Creating volume f2d93389-8279-4ad7-9f53-ae99489522df from snapshot d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-f2d93389-8279-4ad7-9f53-ae99489522df" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:08 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 (6d7b660c-cd93-46e8-ac96-53a655ae9e84): created successfully Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (64af0a14-63e3-4c9e-b4d9-8361d258f200) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (364f5bd4-47ed-4ee9-8e58-41e552000d2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-f2d93389-8279-4ad7-9f53-ae99489522df" acquired by "_copy_volume_from_snapshot" :: waited 0.117s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] snapshot: d1b386bf-5829-41da-b76f-697537ee8e3d, volume: f2d93389-8279-4ad7-9f53-ae99489522df, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-44b88228-77f2-4a45-b607-f8f850df5c8d tempest-CreateVolumesFromSnapshotTest-653654045 None] Created volume successfully. Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff62af36-9ee5-4721-b5a1-196db6996c96]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:09 devstack sudo[102091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d Sep 03 12:05:09 devstack sudo[102091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:09 devstack sudo[102091]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d" returned: 0 in 0.735s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:05:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[26797aaf-6399-4086-a22a-6e0c74b54659]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:09 devstack sudo[102099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a Sep 03 12:05:09 devstack sudo[102099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:10 devstack sudo[102099]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" returned: 0 in 0.526s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:05:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:05:10 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:05:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:10 devstack sudo[102107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df Sep 03 12:05:10 devstack sudo[102107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:05:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:16 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:16 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:17 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 1.221s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:05:17 devstack sudo[102107]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df" returned: 0 in 7.414s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a, size 1024.00 MB, duration 7.41 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:05:17 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Converted 1024.00 MB image at 138.11 MB/s Sep 03 12:05:17 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df is being set with open permissions: ugo+rw Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:17 devstack sudo[102127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df Sep 03 12:05:17 devstack sudo[102127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:17 devstack sudo[102127]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df" returned: 0 in 0.333s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-f2d93389-8279-4ad7-9f53-ae99489522df" released by "_copy_volume_from_snapshot" :: held 9.168s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-d1b386bf-5829-41da-b76f-697537ee8e3d-f2d93389-8279-4ad7-9f53-ae99489522df" released by "_create_volume_from_snapshot" :: held 9.363s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.422s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.520s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Creating offline snapshot d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 of volume 6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5d314fae-ad64-45db-9633-e0eded9c8130) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f2d93389-8279-4ad7-9f53-ae99489522df', 'volume_size': 1, 'snapshot_id': 'd1b386bf-5829-41da-b76f-697537ee8e3d'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f5f194-a460-45f9-b8f7-4d97adabe016) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9b7de18c-d56a-4d59-a5b4-59c1ca1d8531]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Volume volume-f2d93389-8279-4ad7-9f53-ae99489522df (f2d93389-8279-4ad7-9f53-ae99489522df): created successfully Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (04f5f194-a460-45f9-b8f7-4d97adabe016) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Flow 'volume_create_manager' (33fd2aa8-df61-4b18-935b-9daaa4db3965) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1a85dc97-caee-48e3-b33d-0979e95a62ff tempest-VolumesDeleteCascade-722903824 None] Created volume successfully. Sep 03 12:05:18 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 Sep 03 12:05:18 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:18 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84" returned: 0 in 0.532s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:18 devstack sudo[102136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 1G Sep 03 12:05:18 devstack sudo[102136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-18bf01d7-907f-4ac5-9f40-1f1cac6f774a-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-18bf01d7-907f-4ac5-9f40-1f1cac6f774a-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Performing cascade delete. {{(pid=87256) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-d1b386bf-5829-41da-b76f-697537ee8e3d-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-d1b386bf-5829-41da-b76f-697537ee8e3d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:19 devstack sudo[102136]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-d1b386bf-5829-41da-b76f-697537ee8e3d" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 1G" returned: 0 in 0.606s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-d1b386bf-5829-41da-b76f-697537ee8e3d" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Deleting offline snapshot d1b386bf-5829-41da-b76f-697537ee8e3d of volume 18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:05:19 devstack sudo[102143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 Sep 03 12:05:19 devstack sudo[102143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] snapshot_file for this snap is: volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae9990d1-a34d-4fc6-b300-220369bcf13b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:19 devstack sudo[102145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d Sep 03 12:05:19 devstack sudo[102145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:19 devstack sudo[102143]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" returned: 0 in 0.406s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:19 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 is being set with open permissions: ugo+rw Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:19 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 Sep 03 12:05:19 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:19 devstack sudo[102145]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d" returned: 0 in 0.637s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d153a14b-1747-4ef2-a0c2-53238f796eb9]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:20 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" returned: 0 in 0.513s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:20 devstack sudo[102155]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a Sep 03 12:05:20 devstack sudo[102155]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:20 devstack sudo[102158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.info Sep 03 12:05:20 devstack sudo[102158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:20 devstack sudo[102158]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.info" returned: 0 in 0.306s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:20 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.info is being set with open permissions: ugo+rw Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:20 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.info Sep 03 12:05:20 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:20 devstack sudo[102155]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" returned: 0 in 0.799s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:20 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.info" returned: 0 in 0.331s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:20 devstack sudo[102168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d Sep 03 12:05:20 devstack sudo[102168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.858s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-eff2c31c-4ae9-4da9-b705-b82553461170 tempest-CreateVolumesFromSnapshotTest-653654045 None] Create snapshot completed successfully Sep 03 12:05:21 devstack sudo[102168]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d" returned: 0 in 0.460s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:21 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d Sep 03 12:05:21 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:21 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a.d1b386bf-5829-41da-b76f-697537ee8e3d" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-d1b386bf-5829-41da-b76f-697537ee8e3d" released by "_delete_snapshot" :: held 2.327s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" released by "delete_snapshot" :: held 2.367s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Created reservations ['0bcf652c-3a51-428f-b024-0fa229f4157c', 'e8440f75-9304-4788-810b-9314255b7c9d', '32801999-b6b2-4e32-b18b-969fb9b4a2d5', '9a40f809-c11c-438e-b2da-0f72137d39fe'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Delete snapshot completed successfully. Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-d1b386bf-5829-41da-b76f-697537ee8e3d-delete_snapshot" released by "delete_snapshot" :: held 2.559s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Snapshots deleted, issuing volume delete {{(pid=87256) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" acquired by "delete_volume" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[07393567-e467-4cac-b4de-5878ceec8c3a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:22 devstack sudo[102177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a Sep 03 12:05:22 devstack sudo[102177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:22 devstack sudo[102177]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (6ab4196c-595d-4530-a513-f858d7252cc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27335e6-3872-4eb6-8fd2-819b87cfb835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" returned: 0 in 0.741s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c27335e6-3872-4eb6-8fd2-819b87cfb835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177825781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a59fbd-f8d5-40c6-87ff-b0eabb79cd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:22Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:22 devstack sudo[102182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a Sep 03 12:05:22 devstack sudo[102182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f3dcbc-bc96-4b99-a41b-1134831a5cf6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5f3dcbc-bc96-4b99-a41b-1134831a5cf6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4c4e4e-7933-4b74-ac1b-3b0c891d8572) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc4c4e4e-7933-4b74-ac1b-3b0c891d8572) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '01a59fbd-f8d5-40c6-87ff-b0eabb79cd14', 'volume_name': 'volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402bc042-03ba-480f-94fa-fca64c3ebc83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (402bc042-03ba-480f-94fa-fca64c3ebc83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f95726-658d-4c53-a9fa-a4bb1645bfcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:22 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume 01a59fbd-f8d5-40c6-87ff-b0eabb79cd14: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14', 'volume_size': 1} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1177825781',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=01a59fbd-f8d5-40c6-87ff-b0eabb79cd14,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:22Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Creating volume 01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:22 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:22 devstack sudo[102184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 1073741824 Sep 03 12:05:22 devstack sudo[102184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:23 devstack sudo[102182]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" returned: 0 in 0.579s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-18bf01d7-907f-4ac5-9f40-1f1cac6f774a" released by "delete_volume" :: held 1.398s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=121,cinder:INSERT=42,cinder:UPDATE=152,cinder:DELETE=14 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (9d3d71bc-df79-44ae-bc0c-253b14c99210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd792974-675a-4775-bfcb-c9e5d3ae03f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd792974-675a-4775-bfcb-c9e5d3ae03f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1391829203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ecf12b-bce7-4302-afdc-e3f5a36ee817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:23Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9f3d38-ea32-4244-a19f-e98599f122ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a9f3d38-ea32-4244-a19f-e98599f122ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c03cc3a-0ea2-42a0-8d52-1f59fb62af0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:23 devstack sudo[102184]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4c03cc3a-0ea2-42a0-8d52-1f59fb62af0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '41ecf12b-bce7-4302-afdc-e3f5a36ee817', 'volume_name': 'volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b26c799-c22d-4ca6-b74b-1a4485e12c8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b26c799-c22d-4ca6-b74b-1a4485e12c8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a4f29-6564-43b6-aaa0-7ed7d536354b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume 41ecf12b-bce7-4302-afdc-e3f5a36ee817: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817', 'volume_size': 1} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Created reservations ['f6d2414d-4e96-411c-a496-b7b41346005e', '512b1df3-37bb-4cfc-96e7-90524a688a4a', '358e5807-f6d5-4248-ad5b-134db9ee201d', '23d871e4-e008-4f90-aa92-50157a7bfecd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 1073741824" returned: 0 in 0.820s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:23 devstack sudo[102194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 Sep 03 12:05:23 devstack sudo[102194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:23 devstack sudo[102196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:23 devstack sudo[102196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (4a9aeddf-641a-41c2-895f-b3e4517b87b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354e72c9-12f5-4be0-b6ae-48ef660751c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (354e72c9-12f5-4be0-b6ae-48ef660751c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1267220753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ccbfab-f11a-4d8b-ac0a-f79131b016da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:24Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3f9ce1-a5bd-49b9-8981-12ddb1a3bc6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7d3f9ce1-a5bd-49b9-8981-12ddb1a3bc6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5627b732-4479-4ec1-92ba-a36e9d1e6690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5627b732-4479-4ec1-92ba-a36e9d1e6690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9ccbfab-f11a-4d8b-ac0a-f79131b016da', 'volume_name': 'volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae76a75d-4e4c-413f-a848-c3a6856cf856) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae76a75d-4e4c-413f-a848-c3a6856cf856) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1599c49-544b-4100-808b-9d1b2ef4d21d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume b9ccbfab-f11a-4d8b-ac0a-f79131b016da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da', 'volume_size': 1} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:24 devstack sudo[102196]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.604s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Deleted volume successfully. Sep 03 12:05:24 devstack sudo[102194]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14" returned: 0 in 0.725s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] <== create_volume: return (1742ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.754s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.940s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1391829203',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41ecf12b-bce7-4302-afdc-e3f5a36ee817,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:23Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Creating volume 41ecf12b-bce7-4302-afdc-e3f5a36ee817 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:24 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21f95726-658d-4c53-a9fa-a4bb1645bfcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc93e528-b3c6-4150-91e6-7477778eae0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 1073741824 Sep 03 12:05:24 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9213b954-fc53-4a4a-a696-eb20224ff402 tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-18bf01d7-907f-4ac5-9f40-1f1cac6f774a-delete_volume" released by "delete_volume" :: held 5.470s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 (01a59fbd-f8d5-40c6-87ff-b0eabb79cd14): created successfully Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc93e528-b3c6-4150-91e6-7477778eae0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (6ab4196c-595d-4530-a513-f858d7252cc3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9cd5c0fb-6de4-406d-bca1-479abf0380b3 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created volume successfully. Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (dbfd167d-615f-42a9-9642-6ad4450f91ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c304f7e-3a88-45b2-ae67-1aab378bab4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c304f7e-3a88-45b2-ae67-1aab378bab4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324712456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65afc810-d4ef-4a53-aa57-f473324c8f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:25Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17479194-4e29-44da-ba22-1d81eff6acf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (17479194-4e29-44da-ba22-1d81eff6acf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e891da5-6e9d-4252-86f7-096dc327705b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4e891da5-6e9d-4252-86f7-096dc327705b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '65afc810-d4ef-4a53-aa57-f473324c8f66', 'volume_name': 'volume-65afc810-d4ef-4a53-aa57-f473324c8f66', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb5b18f-d0e0-4925-9752-69066eb70f6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3cb5b18f-d0e0-4925-9752-69066eb70f6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522fcd2a-6517-4de0-b601-7aa7640089cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume 65afc810-d4ef-4a53-aa57-f473324c8f66: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-65afc810-d4ef-4a53-aa57-f473324c8f66', 'volume_size': 1} Sep 03 12:05:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-f2d93389-8279-4ad7-9f53-ae99489522df-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-f2d93389-8279-4ad7-9f53-ae99489522df-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "cinder-quobyte-f2d93389-8279-4ad7-9f53-ae99489522df" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-f2d93389-8279-4ad7-9f53-ae99489522df" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (25850934-62f4-4542-a4af-2f1d41495562) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32969394-ca38-4f6d-97df-75e779fd0f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a4efa35a-5a7e-4fbf-b39a-d3e7b830ce8d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (32969394-ca38-4f6d-97df-75e779fd0f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1043032418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b73f28-453d-49cb-b118-0ee88a6c8092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:25Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f5af28-7424-4c7b-8ba7-4397cd076fbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (93f5af28-7424-4c7b-8ba7-4397cd076fbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1913b5a-ad21-478d-99cf-0676aa91792e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a1913b5a-ad21-478d-99cf-0676aa91792e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b73f28-453d-49cb-b118-0ee88a6c8092', 'volume_name': 'volume-34b73f28-453d-49cb-b118-0ee88a6c8092', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f85cb50-7551-4d37-a98d-939573e8e998) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f85cb50-7551-4d37-a98d-939573e8e998) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb239d13-d383-4a24-816a-f72714337736) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume 34b73f28-453d-49cb-b118-0ee88a6c8092: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b73f28-453d-49cb-b118-0ee88a6c8092', 'volume_size': 1} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:25 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 1073741824" returned: 0 in 1.007s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:25 devstack sudo[102206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df Sep 03 12:05:25 devstack sudo[102206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:25 devstack sudo[102208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 Sep 03 12:05:25 devstack sudo[102208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:25 devstack sudo[102206]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df" returned: 0 in 0.514s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:25 devstack sudo[102208]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] <== create_volume: return (1397ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.599s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:25 devstack sudo[102215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1267220753',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b9ccbfab-f11a-4d8b-ac0a-f79131b016da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:24Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Creating volume b9ccbfab-f11a-4d8b-ac0a-f79131b016da {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:25 devstack sudo[102215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:25 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb6a4f29-6564-43b6-aaa0-7ed7d536354b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5261e370-402c-4990-8251-41cf5457eff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:26 devstack sudo[102217]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da 1073741824 Sep 03 12:05:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 (41ecf12b-bce7-4302-afdc-e3f5a36ee817): created successfully Sep 03 12:05:26 devstack sudo[102217]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5261e370-402c-4990-8251-41cf5457eff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (9d3d71bc-df79-44ae-bc0c-253b14c99210) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-18913e7a-b7ac-4e54-bd1c-d5a658b91c1d tempest-CreateVolumesFromSnapshotTest-653654045 None] Created volume successfully. Sep 03 12:05:26 devstack sudo[102215]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f2d93389-8279-4ad7-9f53-ae99489522df" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-quobyte-f2d93389-8279-4ad7-9f53-ae99489522df" released by "delete_volume" :: held 0.952s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Created reservations ['3a0743fc-f00c-44c8-bbe4-f4edf8b59474', '31e54799-418c-420a-b44c-c45c8a164fb8', 'db251326-5fd1-40d6-a628-4814571e40ec', 'ab6f00bb-7d56-4970-9d89-e447635f46cd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:26 devstack sudo[102223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:26 devstack sudo[102223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:26 devstack sudo[102217]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da 1073741824" returned: 0 in 0.777s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:26 devstack sudo[102223]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.351s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Deleted volume successfully. Sep 03 12:05:26 devstack sudo[102227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da Sep 03 12:05:26 devstack sudo[102227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8709b1d9-500c-4c1e-a870-b541d2fd15fe tempest-VolumesDeleteCascade-722903824 None] Lock "cinder-f2d93389-8279-4ad7-9f53-ae99489522df-delete_volume" released by "delete_volume" :: held 1.655s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:27 devstack sudo[102227]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da" returned: 0 in 0.338s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] <== create_volume: return (1182ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.283s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-324712456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=65afc810-d4ef-4a53-aa57-f473324c8f66,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:25Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Creating volume 65afc810-d4ef-4a53-aa57-f473324c8f66 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:27 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1599c49-544b-4100-808b-9d1b2ef4d21d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587a7349-95e1-4bb4-9f45-f3fc2ff3ec62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:27 devstack sudo[102230]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 1073741824 Sep 03 12:05:27 devstack sudo[102230]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:27 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da (b9ccbfab-f11a-4d8b-ac0a-f79131b016da): created successfully Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (587a7349-95e1-4bb4-9f45-f3fc2ff3ec62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (4a9aeddf-641a-41c2-895f-b3e4517b87b1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3a812d97-54b3-400e-8f60-8ad972f06073 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created volume successfully. Sep 03 12:05:27 devstack sudo[102230]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 1073741824" returned: 0 in 0.731s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:27 devstack sudo[102296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 Sep 03 12:05:27 devstack sudo[102296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:28 devstack sudo[102296]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66" returned: 0 in 0.371s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] <== create_volume: return (1164ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.170s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.827s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1043032418',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b73f28-453d-49cb-b118-0ee88a6c8092,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c9f0984b17104cfbb764f509f1363656',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:25Z,use_quota=True,user_id='e510fc3a3e204f20971c26e202fd4dfc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Creating volume 34b73f28-453d-49cb-b118-0ee88a6c8092 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:28 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (522fcd2a-6517-4de0-b601-7aa7640089cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-65afc810-d4ef-4a53-aa57-f473324c8f66', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28da9a52-cd1e-4326-a082-0af719eb84cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:28 devstack sudo[102301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 1073741824 Sep 03 12:05:28 devstack sudo[102301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:28 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume volume-65afc810-d4ef-4a53-aa57-f473324c8f66 (65afc810-d4ef-4a53-aa57-f473324c8f66): created successfully Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (28da9a52-cd1e-4326-a082-0af719eb84cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (dbfd167d-615f-42a9-9642-6ad4450f91ca) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b6f8050f-9cf0-499e-8f72-a509e38104b2 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created volume successfully. Sep 03 12:05:29 devstack sudo[102301]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 1073741824" returned: 0 in 0.714s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:29 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 Sep 03 12:05:29 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:29 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092" returned: 0 in 0.443s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] <== create_volume: return (1212ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.216s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cb239d13-d383-4a24-816a-f72714337736) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b73f28-453d-49cb-b118-0ee88a6c8092', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befc49e7-d50a-437c-8132-c6e82fa9cd44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Volume volume-34b73f28-453d-49cb-b118-0ee88a6c8092 (34b73f28-453d-49cb-b118-0ee88a6c8092): created successfully Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (befc49e7-d50a-437c-8132-c6e82fa9cd44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Flow 'volume_create_manager' (25850934-62f4-4542-a4af-2f1d41495562) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fa7036af-0f34-4da9-b3a4-ea52657ee506 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created volume successfully. Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-34b73f28-453d-49cb-b118-0ee88a6c8092-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-34b73f28-453d-49cb-b118-0ee88a6c8092-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-34b73f28-453d-49cb-b118-0ee88a6c8092" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-34b73f28-453d-49cb-b118-0ee88a6c8092" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f72c6fbb-d5f2-4532-a876-d713865bb904]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:30 devstack sudo[102316]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 Sep 03 12:05:30 devstack sudo[102316]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:30 devstack sudo[102316]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092" returned: 0 in 0.457s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:30 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092 Sep 03 12:05:30 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:30 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-34b73f28-453d-49cb-b118-0ee88a6c8092" returned: 0 in 0.274s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-34b73f28-453d-49cb-b118-0ee88a6c8092" released by "delete_volume" :: held 0.782s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created reservations ['f27a43a9-0484-4626-9964-b3b8546b72e2', '45b03da2-ebfe-4c6e-afc9-79b4761dc965', 'cbfb6943-dd1a-4ce1-8dc4-a9fa6a011e27', '58481295-be18-4276-bf9d-9546e2974fba'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:31 devstack sudo[102326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:31 devstack sudo[102326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-65afc810-d4ef-4a53-aa57-f473324c8f66-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-65afc810-d4ef-4a53-aa57-f473324c8f66-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:31 devstack sudo[102326]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.313s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Deleted volume successfully. Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-65afc810-d4ef-4a53-aa57-f473324c8f66" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2db93101-94ce-4b64-a34b-d35f6b80bff1 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-34b73f28-453d-49cb-b118-0ee88a6c8092-delete_volume" released by "delete_volume" :: held 1.392s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-65afc810-d4ef-4a53-aa57-f473324c8f66" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3be96f6d-cc0b-464f-9b4d-0faeeb0f49b6]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:31 devstack sudo[102329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 Sep 03 12:05:31 devstack sudo[102329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:31 devstack sudo[102329]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66" returned: 0 in 0.387s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:31 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66 Sep 03 12:05:31 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:32 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-65afc810-d4ef-4a53-aa57-f473324c8f66" returned: 0 in 0.422s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-65afc810-d4ef-4a53-aa57-f473324c8f66" released by "delete_volume" :: held 0.856s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created reservations ['c05f8602-aef3-48e2-a4d6-a42aee703478', '583b3d15-716f-4f85-82b1-d46beee15cc4', '9d709b7a-5b00-442a-9353-4dba48654635', 'c4041e4d-8de1-4200-99d8-f7d8d723870d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:32 devstack sudo[102337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:32 devstack sudo[102337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-b9ccbfab-f11a-4d8b-ac0a-f79131b016da-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-b9ccbfab-f11a-4d8b-ac0a-f79131b016da-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-b9ccbfab-f11a-4d8b-ac0a-f79131b016da" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-b9ccbfab-f11a-4d8b-ac0a-f79131b016da" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa4f27f5-cf1b-4cda-ae1a-7d793263a6df]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:32 devstack sudo[102337]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.327s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Deleted volume successfully. Sep 03 12:05:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-078f6f1c-f8ae-459a-b621-9e88bea90694 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-65afc810-d4ef-4a53-aa57-f473324c8f66-delete_volume" released by "delete_volume" :: held 1.509s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:32 devstack sudo[102340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da Sep 03 12:05:32 devstack sudo[102340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:33 devstack sudo[102340]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da" returned: 0 in 0.545s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:33 devstack sudo[102347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da Sep 03 12:05:33 devstack sudo[102347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Flow 'volume_create_manager' (e9c1787a-3c6b-45d3-bb25-d1252b926bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d410b7e-a128-4095-b17d-6c06096dd7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d410b7e-a128-4095-b17d-6c06096dd7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1150250232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4401a3-e424-4776-a182-55828c5b1be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8f94bdbbf141cdbda4eca4baaff536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:33Z,use_quota=True,user_id='6d944eb246d84e2c92f9ad46ab38e6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db5c24c-4478-4868-9ba9-34ff5c3c35c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8db5c24c-4478-4868-9ba9-34ff5c3c35c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ba38e-3e4e-4c32-93bc-bcf2bf19162a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e9ba38e-3e4e-4c32-93bc-bcf2bf19162a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1b4401a3-e424-4776-a182-55828c5b1be8', 'volume_name': 'volume-1b4401a3-e424-4776-a182-55828c5b1be8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85031e9-d0b8-43b0-bc37-28b2d4c193b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85031e9-d0b8-43b0-bc37-28b2d4c193b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395f0729-579c-4c98-bdaa-1b577d9ce84c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:33 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Volume 1b4401a3-e424-4776-a182-55828c5b1be8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1b4401a3-e424-4776-a182-55828c5b1be8', 'volume_size': 1} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1150250232',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1b4401a3-e424-4776-a182-55828c5b1be8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8f94bdbbf141cdbda4eca4baaff536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:33Z,use_quota=True,user_id='6d944eb246d84e2c92f9ad46ab38e6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Creating volume 1b4401a3-e424-4776-a182-55828c5b1be8 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:33 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:33 devstack sudo[102349]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 1073741824 Sep 03 12:05:33 devstack sudo[102349]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:33 devstack sudo[102347]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b9ccbfab-f11a-4d8b-ac0a-f79131b016da" returned: 0 in 0.367s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-b9ccbfab-f11a-4d8b-ac0a-f79131b016da" released by "delete_volume" :: held 0.981s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Created reservations ['ce188611-1ed9-4f65-bcba-3ec4b687542d', '926ac2dc-42c1-4207-9233-5d73f28166a4', 'b20f0660-5619-4801-ac13-2f090ddf8005', '7b78798f-cad2-4653-85ce-49645a91be51'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:33 devstack sudo[102356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:33 devstack sudo[102356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:34 devstack sudo[102349]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 1073741824" returned: 0 in 0.616s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:34 devstack sudo[102356]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:34 devstack sudo[102360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 Sep 03 12:05:34 devstack sudo[102360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.327s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Deleted volume successfully. Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-79c58dde-4a0b-447f-a00f-8f88c4cd96eb tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-b9ccbfab-f11a-4d8b-ac0a-f79131b016da-delete_volume" released by "delete_volume" :: held 1.683s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:34 devstack sudo[102360]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8" returned: 0 in 0.381s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] <== create_volume: return (1045ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.051s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (395f0729-579c-4c98-bdaa-1b577d9ce84c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1b4401a3-e424-4776-a182-55828c5b1be8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd74a004-4a79-4dfb-be01-b5b6a414c475) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Volume volume-1b4401a3-e424-4776-a182-55828c5b1be8 (1b4401a3-e424-4776-a182-55828c5b1be8): created successfully Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd74a004-4a79-4dfb-be01-b5b6a414c475) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Flow 'volume_create_manager' (e9c1787a-3c6b-45d3-bb25-d1252b926bfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7a0a2969-c304-4a7a-a2e0-acf0f4158e0e tempest-VolumesTransfersV355Test-2049772668 None] Created volume successfully. Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-41ecf12b-bce7-4302-afdc-e3f5a36ee817-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-41ecf12b-bce7-4302-afdc-e3f5a36ee817-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-41ecf12b-bce7-4302-afdc-e3f5a36ee817" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-41ecf12b-bce7-4302-afdc-e3f5a36ee817" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f92fa745-be98-474e-9638-03137b168de1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:35 devstack sudo[102363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 Sep 03 12:05:35 devstack sudo[102363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:35 devstack sudo[102363]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817" returned: 0 in 0.383s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:35 devstack sudo[102368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817 Sep 03 12:05:35 devstack sudo[102368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:35 devstack sudo[102368]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-41ecf12b-bce7-4302-afdc-e3f5a36ee817" returned: 0 in 0.383s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-41ecf12b-bce7-4302-afdc-e3f5a36ee817" released by "delete_volume" :: held 0.820s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created reservations ['6f5eeccc-a6e1-4569-a6d4-dcd7f8ef178f', '9c1abc4b-8e5a-4514-bb83-63d116492249', '8a898c03-0f9a-4622-8f63-442ebe69143a', 'e0650c51-b777-4630-aaea-e9d5be4768d8'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:36 devstack sudo[102371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:36 devstack sudo[102371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a9d917bc-8973-4814-9a82-bb9a6512899a tempest-VolumesTransfersV355Test-673424216 None] Transfer volume completed successfully. Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14" acquired by "delete_volume" :: waited 0.040s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[572c04c8-3f9d-4927-9f30-7d06963dca43]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:36 devstack sudo[102371]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Deleted volume successfully. Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f6aecbae-9731-47a0-a0a0-1c0261c7e197 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-41ecf12b-bce7-4302-afdc-e3f5a36ee817-delete_volume" released by "delete_volume" :: held 1.682s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:36 devstack sudo[102374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 Sep 03 12:05:36 devstack sudo[102374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:36 devstack sudo[102374]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14" returned: 0 in 0.566s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:37 devstack sudo[102379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14 Sep 03 12:05:37 devstack sudo[102379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Acquiring lock "cinder-1b4401a3-e424-4776-a182-55828c5b1be8-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-1b4401a3-e424-4776-a182-55828c5b1be8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Acquiring lock "cinder-quobyte-1b4401a3-e424-4776-a182-55828c5b1be8" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-quobyte-1b4401a3-e424-4776-a182-55828c5b1be8" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d57fe22b-d7e7-4bd8-a63f-a3da46f3fbd1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:37 devstack sudo[102379]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14" returned: 0 in 0.478s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14" released by "delete_volume" :: held 1.139s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:37 devstack sudo[102382]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 Sep 03 12:05:37 devstack sudo[102382]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created reservations ['e2274efd-a355-4c84-9030-31074a93deba', '73e15561-6da3-4ba9-a044-8afd1cfff129', 'c65b80ec-f870-43a5-9be1-1e37db135911', '0bfca7a8-74fd-4b91-8ecc-cd87843c623d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:37 devstack sudo[102384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:37 devstack sudo[102384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:37 devstack sudo[102382]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8" returned: 0 in 0.595s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:38 devstack sudo[102389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8 Sep 03 12:05:38 devstack sudo[102389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:38 devstack sudo[102384]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.361s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:38 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Deleted volume successfully. Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0f9160ab-ebdb-4c13-bafc-c7f0f5187527 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-01a59fbd-f8d5-40c6-87ff-b0eabb79cd14-delete_volume" released by "delete_volume" :: held 1.895s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:38 devstack sudo[102389]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-1b4401a3-e424-4776-a182-55828c5b1be8" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-quobyte-1b4401a3-e424-4776-a182-55828c5b1be8" released by "delete_volume" :: held 0.952s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Created reservations ['6a43287d-5e87-4639-a257-358c49dfeaaf', 'cebd5e76-14bf-4eac-89cf-956274f22776', '529205d9-d81b-4202-95ad-45a33e20e66c', '91617288-82ff-42f4-8bd7-47e23ed89631'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:38 devstack sudo[102404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:38 devstack sudo[102404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-d2be35ab-0db3-4ee7-a13d-fa0758cefdc2-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-d2be35ab-0db3-4ee7-a13d-fa0758cefdc2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-6d7b660c-cd93-46e8-ac96-53a655ae9e84" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-6d7b660c-cd93-46e8-ac96-53a655ae9e84" acquired by "delete_snapshot" :: waited 0.048s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Deleting offline snapshot d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 of volume 6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] snapshot_file for this snap is: volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dc89a7-f99d-40b5-a88f-7091b0ca2a43]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:38 devstack sudo[102404]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.345s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:38 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Deleted volume successfully. Sep 03 12:05:38 devstack sudo[102407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 Sep 03 12:05:38 devstack sudo[102407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1e92719f-edc2-4292-aab6-0d6a40a6bde7 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-1b4401a3-e424-4776-a182-55828c5b1be8-delete_volume" released by "delete_volume" :: held 1.673s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:39 devstack sudo[102407]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" returned: 0 in 0.582s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:05:39 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d3f550bd-6da9-4083-8b81-426dce8af45c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:39 devstack sudo[102416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 Sep 03 12:05:39 devstack sudo[102416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:40 devstack sudo[102416]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84" returned: 0 in 0.710s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:40 devstack sudo[102425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 Sep 03 12:05:40 devstack sudo[102425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Flow 'volume_create_manager' (35c621b5-a315-4801-8fee-95f65774a432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff152a98-a993-4aca-b41c-e65dd524b9d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ff152a98-a993-4aca-b41c-e65dd524b9d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-294622273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a81a691-a20e-48c3-9247-40ea39af5a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8f94bdbbf141cdbda4eca4baaff536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:40Z,use_quota=True,user_id='6d944eb246d84e2c92f9ad46ab38e6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65f26d9-4fe4-4b4c-8406-da73664e6460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a65f26d9-4fe4-4b4c-8406-da73664e6460) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abb905a-70bc-47a3-a995-0d72822c8373) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0abb905a-70bc-47a3-a995-0d72822c8373) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a81a691-a20e-48c3-9247-40ea39af5a30', 'volume_name': 'volume-3a81a691-a20e-48c3-9247-40ea39af5a30', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fe8471-c4ed-47e8-b3b8-4c497c8a6e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (64fe8471-c4ed-47e8-b3b8-4c497c8a6e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4584acb-402d-4e73-92f6-6cf9578c0583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:40 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Volume 3a81a691-a20e-48c3-9247-40ea39af5a30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a81a691-a20e-48c3-9247-40ea39af5a30', 'volume_size': 1} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-294622273',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a81a691-a20e-48c3-9247-40ea39af5a30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a8f94bdbbf141cdbda4eca4baaff536',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:40Z,use_quota=True,user_id='6d944eb246d84e2c92f9ad46ab38e6e1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Creating volume 3a81a691-a20e-48c3-9247-40ea39af5a30 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:40 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:40 devstack sudo[102433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 1073741824 Sep 03 12:05:40 devstack sudo[102433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:40 devstack sudo[102425]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" returned: 0 in 0.543s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:40 devstack sudo[102438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2 Sep 03 12:05:40 devstack sudo[102438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:40 devstack sudo[102438]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84.d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" returned: 0 in 0.347s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-d2be35ab-0db3-4ee7-a13d-fa0758cefdc2" released by "_delete_snapshot" :: held 2.357s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-6d7b660c-cd93-46e8-ac96-53a655ae9e84" released by "delete_snapshot" :: held 2.394s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:41 devstack sudo[102433]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 1073741824" returned: 0 in 0.509s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:41 devstack sudo[102445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 Sep 03 12:05:41 devstack sudo[102445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Created reservations ['67bfa548-6da6-4418-91bc-e49e51e26fb2', 'f17c8232-67a0-466b-940d-09858f4aba98', '32998f97-e734-4c1e-b705-a611b484db7f', '404b9913-ef5f-4376-ac3f-85bc5e4ad3c5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:41 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Delete snapshot completed successfully. Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eaf25e0e-4ef3-4444-9f70-2cd6bdfd2f6d tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-d2be35ab-0db3-4ee7-a13d-fa0758cefdc2-delete_snapshot" released by "delete_snapshot" :: held 2.700s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:41 devstack sudo[102445]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30" returned: 0 in 0.388s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] <== create_volume: return (991ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.995s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a4584acb-402d-4e73-92f6-6cf9578c0583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a81a691-a20e-48c3-9247-40ea39af5a30', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766d6268-8d97-493a-8e4c-13458f809b8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:41 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Volume volume-3a81a691-a20e-48c3-9247-40ea39af5a30 (3a81a691-a20e-48c3-9247-40ea39af5a30): created successfully Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (766d6268-8d97-493a-8e4c-13458f809b8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Flow 'volume_create_manager' (35c621b5-a315-4801-8fee-95f65774a432) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:41 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5c45c57f-0ef4-4528-a941-5c8006441c3e tempest-VolumesTransfersV355Test-2049772668 None] Created volume successfully. Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-6d7b660c-cd93-46e8-ac96-53a655ae9e84-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-6d7b660c-cd93-46e8-ac96-53a655ae9e84-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "cinder-quobyte-6d7b660c-cd93-46e8-ac96-53a655ae9e84" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-6d7b660c-cd93-46e8-ac96-53a655ae9e84" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:42 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[08899007-d9bd-4b5c-b234-19a9ba2e5950]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:42 devstack sudo[102468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 Sep 03 12:05:42 devstack sudo[102468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-fe04a656-a9e2-4fe0-9802-42ea2a836467 req-5b9abcfa-d3ad-4333-80f3-1057304ad255 tempest-TestShelveInstance-1166583260 None] Terminate volume connection completed successfully. Sep 03 12:05:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-fe04a656-a9e2-4fe0-9802-42ea2a836467 req-5b9abcfa-d3ad-4333-80f3-1057304ad255 tempest-TestShelveInstance-1166583260 None] Deleting attachment 0673f4a0-c069-448c-94c5-e094d419f5a2. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:05:42 devstack sudo[102468]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84" returned: 0 in 0.523s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:42 devstack sudo[102474]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84 Sep 03 12:05:42 devstack sudo[102474]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:43 devstack sudo[102474]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Acquiring lock "cinder-3a81a691-a20e-48c3-9247-40ea39af5a30-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6d7b660c-cd93-46e8-ac96-53a655ae9e84" returned: 0 in 0.460s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-3a81a691-a20e-48c3-9247-40ea39af5a30-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-quobyte-6d7b660c-cd93-46e8-ac96-53a655ae9e84" released by "delete_volume" :: held 1.154s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Acquiring lock "cinder-quobyte-3a81a691-a20e-48c3-9247-40ea39af5a30" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-quobyte-3a81a691-a20e-48c3-9247-40ea39af5a30" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Created reservations ['81ce2f32-967c-469a-aae2-112e4e72020d', 'ef3696b1-0037-4e71-a3d6-58f9fda90868', '8f570fcc-5ed1-4af1-9395-f4f2e6bd8c1e', '0cd45978-89a6-45bb-a8e7-b21164a0f23c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb9058c8-1d05-454c-94c1-205bd96b198b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:43 devstack sudo[102478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:43 devstack sudo[102478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:43 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 Sep 03 12:05:43 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:43 devstack sudo[102478]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Deleted volume successfully. Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cece84dc-96db-42b8-b8d9-f45128ecbde6 tempest-CreateVolumesFromSnapshotTest-653654045 None] Lock "cinder-6d7b660c-cd93-46e8-ac96-53a655ae9e84-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:43 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30" returned: 0 in 0.482s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:43 devstack sudo[102486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30 Sep 03 12:05:43 devstack sudo[102486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:44 devstack sudo[102486]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3a81a691-a20e-48c3-9247-40ea39af5a30" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-quobyte-3a81a691-a20e-48c3-9247-40ea39af5a30" released by "delete_volume" :: held 0.809s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=164,cinder:UPDATE=202,cinder:INSERT=51,cinder:DELETE=19 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Created reservations ['e8bb83fd-4d35-41bb-86d7-05e84e9c6d2e', '1ff13848-852e-4bf7-b7fc-11807688c21a', 'eb2f4436-4cd1-44b2-b272-555912c1290f', '1df3e81f-f867-4fa2-ac14-6ed50aa8e378'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:44 devstack sudo[102489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:05:44 devstack sudo[102489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:44 devstack sudo[102489]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.353s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:05:44 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Deleted volume successfully. Sep 03 12:05:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ba8dd00c-8e1f-435d-b208-d3dbe9aacf65 tempest-VolumesTransfersV355Test-1465343990 None] Lock "cinder-3a81a691-a20e-48c3-9247-40ea39af5a30-delete_volume" released by "delete_volume" :: held 1.504s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:05:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-1e9a45cb-b589-4efe-be63-aa3d0c2171ce req-22f8dba0-d25d-483a-afff-4939c81e3693 tempest-TestShelveInstance-1166583260 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-1e9a45cb-b589-4efe-be63-aa3d0c2171ce req-22f8dba0-d25d-483a-afff-4939c81e3693 tempest-TestShelveInstance-1166583260 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-1e9a45cb-b589-4efe-be63-aa3d0c2171ce req-22f8dba0-d25d-483a-afff-4939c81e3693 tempest-TestShelveInstance-1166583260 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-1e9a45cb-b589-4efe-be63-aa3d0c2171ce req-22f8dba0-d25d-483a-afff-4939c81e3693 tempest-TestShelveInstance-1166583260 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-7dc412e6-8587-4625-bab3-3d5332453b4b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b5a5c333-fd8d-4060-b8f6-a9f4f018eb6a', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:05:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-1e9a45cb-b589-4efe-be63-aa3d0c2171ce req-22f8dba0-d25d-483a-afff-4939c81e3693 tempest-TestShelveInstance-1166583260 None] attachment_update completed successfully. Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Flow 'volume_create_manager' (0e7c7e06-86b2-4cf1-a453-b1b8f24385a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a5c1e9-0e70-4422-920a-ac1e61fe5839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (29a5c1e9-0e70-4422-920a-ac1e61fe5839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71b3d99-a862-4f12-8e74-0932839d2ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187ffe395f764e89884f28d50c187220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:54Z,use_quota=True,user_id='ef9ff3074e0340b2a484e7cf24f8bd2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4d7d13-86c3-41d9-8302-ab27b53c0b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d4d7d13-86c3-41d9-8302-ab27b53c0b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0f85ae-6396-42e0-bd7b-9515ac8aeb09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:54 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd0f85ae-6396-42e0-bd7b-9515ac8aeb09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c71b3d99-a862-4f12-8e74-0932839d2ecb', 'volume_name': 'volume-c71b3d99-a862-4f12-8e74-0932839d2ecb', 'volume_size': 1, 'image_id': 'd361786d-95e3-45fa-a71f-c1d3d10120fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d361786d-95e3-45fa-a71f-c1d3d10120fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c2adbc7c76ccf1a9fc8d1ff1d49cffdb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '187ffe395f764e89884f28d50c187220', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c29babfa766cd3b509afd3e86e388da0976e7eabf5b693dd8f6ef3293d3ed32c1321c299640e2261ceba9fba1eb06015c0208967f4a2e0a49f1d6f37b4276490', 'id': 'd361786d-95e3-45fa-a71f-c1d3d10120fd', 'created_at': datetime.datetime(2026, 9, 3, 10, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 5, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d361786d-95e3-45fa-a71f-c1d3d10120fd/file', 'properties': {}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ad60bc-d5b8-45fc-9ebd-89ea7eedf405) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68ad60bc-d5b8-45fc-9ebd-89ea7eedf405) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29adce4-2af0-4a23-a08e-5fe483ffb251) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:55 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Volume c71b3d99-a862-4f12-8e74-0932839d2ecb: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c71b3d99-a862-4f12-8e74-0932839d2ecb', 'volume_size': 1, 'image_id': 'd361786d-95e3-45fa-a71f-c1d3d10120fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d361786d-95e3-45fa-a71f-c1d3d10120fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c2adbc7c76ccf1a9fc8d1ff1d49cffdb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '187ffe395f764e89884f28d50c187220', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c29babfa766cd3b509afd3e86e388da0976e7eabf5b693dd8f6ef3293d3ed32c1321c299640e2261ceba9fba1eb06015c0208967f4a2e0a49f1d6f37b4276490', 'id': 'd361786d-95e3-45fa-a71f-c1d3d10120fd', 'created_at': datetime.datetime(2026, 9, 3, 10, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 5, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d361786d-95e3-45fa-a71f-c1d3d10120fd/file', 'properties': {}}, 'image_service': } Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Trying to clone c71b3d99-a862-4f12-8e74-0932839d2ecb from image d361786d-95e3-45fa-a71f-c1d3d10120fd at location (None, [{'url': 'file:///opt/stack/data/glance/images/d361786d-95e3-45fa-a71f-c1d3d10120fd', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:05:55 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Image download 0.00 MB at 0.00 MB/s Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a57c4612-c287-435f-9cbb-6be3fdb29256]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:55 devstack sudo[102948]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD Sep 03 12:05:55 devstack sudo[102948]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Flow 'volume_create_manager' (28a209df-08b3-4a27-8d03-0df4497ad772) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b65589-44cf-4b79-b43c-ebb0c4352583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:56 devstack sudo[102948]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD" returned: 0 in 0.580s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (52b65589-44cf-4b79-b43c-ebb0c4352583) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-308663016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e31386-3491-49d9-9f54-28ca77b9f2a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca12c3e9441f465abc9ca02e6c7fa133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:56Z,use_quota=True,user_id='dd5accf06bcd4efb8aeb5c71a7a9d75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a15892f-1332-469d-a1df-c9cd8342c9fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4a15892f-1332-469d-a1df-c9cd8342c9fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff920e20-ba52-455b-b083-8d3b4c78a7db) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ff920e20-ba52-455b-b083-8d3b4c78a7db) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55e31386-3491-49d9-9f54-28ca77b9f2a3', 'volume_name': 'volume-55e31386-3491-49d9-9f54-28ca77b9f2a3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db24b134-68ac-4b7e-8d37-4d254650d29c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db24b134-68ac-4b7e-8d37-4d254650d29c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e24fd58-5fea-4361-a804-3102e159fa4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:56 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Volume 55e31386-3491-49d9-9f54-28ca77b9f2a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55e31386-3491-49d9-9f54-28ca77b9f2a3', 'volume_size': 1} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-308663016',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55e31386-3491-49d9-9f54-28ca77b9f2a3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca12c3e9441f465abc9ca02e6c7fa133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:56Z,use_quota=True,user_id='dd5accf06bcd4efb8aeb5c71a7a9d75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Creating volume 55e31386-3491-49d9-9f54-28ca77b9f2a3 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:56 devstack sudo[102952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD Sep 03 12:05:56 devstack sudo[102952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:56 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:56 devstack sudo[102957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 1073741824 Sep 03 12:05:56 devstack sudo[102957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:56 devstack sudo[102952]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD" returned: 1 in 0.485s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Temporary image d361786d-95e3-45fa-a71f-c1d3d10120fd is fetched for user ef9ff3074e0340b2a484e7cf24f8bd2a. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f42e9b5b-eb1d-488f-9c53-530b723cbdaa]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:56 devstack sudo[102963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD Sep 03 12:05:56 devstack sudo[102963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:57 devstack sudo[102957]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 1073741824" returned: 0 in 0.786s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:57 devstack sudo[102968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 Sep 03 12:05:57 devstack sudo[102968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:57 devstack sudo[102963]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD" returned: 0 in 0.528s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:57 devstack sudo[102972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD Sep 03 12:05:57 devstack sudo[102972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:57 devstack sudo[102968]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3" returned: 0 in 0.305s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] <== create_volume: return (1188ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.206s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e24fd58-5fea-4361-a804-3102e159fa4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55e31386-3491-49d9-9f54-28ca77b9f2a3', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea633eae-7396-4f42-9907-5ae4d57badbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Volume volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 (55e31386-3491-49d9-9f54-28ca77b9f2a3): created successfully Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ea633eae-7396-4f42-9907-5ae4d57badbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Flow 'volume_create_manager' (28a209df-08b3-4a27-8d03-0df4497ad772) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bca804dd-8cde-45a7-9de5-d819887b6b64 tempest-VolumesListTestJSON-1475331933 None] Created volume successfully. Sep 03 12:05:57 devstack sudo[102972]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD" returned: 1 in 0.499s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:54Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c71b3d99-a862-4f12-8e74-0932839d2ecb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='187ffe395f764e89884f28d50c187220',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:54Z,use_quota=True,user_id='ef9ff3074e0340b2a484e7cf24f8bd2a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Creating volume c71b3d99-a862-4f12-8e74-0932839d2ecb {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:57 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:57 devstack sudo[102978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb 1073741824 Sep 03 12:05:57 devstack sudo[102978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:58 devstack sudo[102978]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb 1073741824" returned: 0 in 0.673s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:58 devstack sudo[102987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb Sep 03 12:05:58 devstack sudo[102987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:59 devstack sudo[102987]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb" returned: 0 in 0.493s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] <== create_volume: return (1225ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.228s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Attempting download of d361786d-95e3-45fa-a71f-c1d3d10120fd ((None, [{'url': 'file:///opt/stack/data/glance/images/d361786d-95e3-45fa-a71f-c1d3d10120fd', 'metadata': {}}])) to volume c71b3d99-a862-4f12-8e74-0932839d2ecb. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Flow 'volume_create_manager' (e855587d-b33e-4183-8557-1143763086d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9067786-248f-4b51-826d-33767f8ae43e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9067786-248f-4b51-826d-33767f8ae43e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1331988170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbd27e2-962f-40e9-b53b-fd11790b4955,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca12c3e9441f465abc9ca02e6c7fa133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:59Z,use_quota=True,user_id='dd5accf06bcd4efb8aeb5c71a7a9d75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2029c86f-6970-46ea-9b73-27cbf420b834) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2029c86f-6970-46ea-9b73-27cbf420b834) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd127166-bf41-4420-b69b-0e980f959f43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd127166-bf41-4420-b69b-0e980f959f43) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6bbd27e2-962f-40e9-b53b-fd11790b4955', 'volume_name': 'volume-6bbd27e2-962f-40e9-b53b-fd11790b4955', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f7ebb2-4743-4f3d-b3e6-5f6c5542d520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c9f7ebb2-4743-4f3d-b3e6-5f6c5542d520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c0574-7e32-4471-ba59-7eca4f1885e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:05:59 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Volume 6bbd27e2-962f-40e9-b53b-fd11790b4955: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6bbd27e2-962f-40e9-b53b-fd11790b4955', 'volume_size': 1} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:05:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1331988170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bbd27e2-962f-40e9-b53b-fd11790b4955,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca12c3e9441f465abc9ca02e6c7fa133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:05:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:05:59Z,use_quota=True,user_id='dd5accf06bcd4efb8aeb5c71a7a9d75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Creating volume 6bbd27e2-962f-40e9-b53b-fd11790b4955 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:05:59 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb5e0ec0-c7b0-4c1e-bf4e-e30337778915]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d361786d-95e3-45fa-a71f-c1d3d10120fd_gu9cpjpy {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:59 devstack sudo[102990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 1073741824 Sep 03 12:05:59 devstack sudo[102990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:59 devstack sudo[102991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d361786d-95e3-45fa-a71f-c1d3d10120fd_gu9cpjpy Sep 03 12:05:59 devstack sudo[102991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:05:59 devstack sudo[102991]: pam_unix(sudo:session): session closed for user root Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d361786d-95e3-45fa-a71f-c1d3d10120fd_gu9cpjpy" returned: 0 in 0.437s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:05:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d361786d-95e3-45fa-a71f-c1d3d10120fd_gu9cpjpy {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:05:59 devstack sudo[102999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d361786d-95e3-45fa-a71f-c1d3d10120fd_gu9cpjpy Sep 03 12:05:59 devstack sudo[102999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:00 devstack sudo[102990]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 1073741824" returned: 0 in 0.818s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:00 devstack sudo[102999]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d361786d-95e3-45fa-a71f-c1d3d10120fd_gu9cpjpy" returned: 1 in 0.484s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d361786d-95e3-45fa-a71f-c1d3d10120fd_gu9cpjpy' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3f3474e-99f3-41f4-974a-4207cbb4e269]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:00 devstack sudo[103003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 Sep 03 12:06:00 devstack sudo[103003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:00 devstack sudo[103005]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD Sep 03 12:06:00 devstack sudo[103005]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:00 devstack sudo[103003]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955" returned: 0 in 0.417s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] <== create_volume: return (1361ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.364s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1c0574-7e32-4471-ba59-7eca4f1885e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bbd27e2-962f-40e9-b53b-fd11790b4955', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460db263-541f-493c-96a8-a7f5f568b3c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Volume volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 (6bbd27e2-962f-40e9-b53b-fd11790b4955): created successfully Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (460db263-541f-493c-96a8-a7f5f568b3c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Flow 'volume_create_manager' (e855587d-b33e-4183-8557-1143763086d4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2bdd7931-2d1d-4534-aef7-40ecd98d7736 tempest-VolumesListTestJSON-1475331933 None] Created volume successfully. Sep 03 12:06:00 devstack sudo[103005]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD" returned: 0 in 0.578s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:01 devstack sudo[103016]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD Sep 03 12:06:01 devstack sudo[103016]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:01 devstack sudo[103016]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD" returned: 1 in 0.630s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:06:01 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] d361786d-95e3-45fa-a71f-c1d3d10120fd was raw, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:06:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:01 devstack sudo[103034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb Sep 03 12:06:01 devstack sudo[103034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:02 devstack sudo[103034]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb" returned: 0 in 0.810s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d361786d-95e3-45fa-a71f-c1d3d10120fd_3ju07n_wdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:06:02 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:02 devstack sudo[103040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb 1G Sep 03 12:06:02 devstack sudo[103040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Flow 'volume_create_manager' (f1da3f90-5390-49b5-84e0-a162dd990c0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96681899-2539-4621-8046-85c2f19d9d98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (96681899-2539-4621-8046-85c2f19d9d98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1102244850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9056ae83-813b-47a2-a7bb-c04165bfe073,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca12c3e9441f465abc9ca02e6c7fa133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:02Z,use_quota=True,user_id='dd5accf06bcd4efb8aeb5c71a7a9d75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfd2d84-3954-4181-b7aa-f2a96212e702) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cdfd2d84-3954-4181-b7aa-f2a96212e702) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082de602-e547-48b4-bfd0-0ac629279194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (082de602-e547-48b4-bfd0-0ac629279194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9056ae83-813b-47a2-a7bb-c04165bfe073', 'volume_name': 'volume-9056ae83-813b-47a2-a7bb-c04165bfe073', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3c7096-a776-48b4-bbd5-65f9ecb1e144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb3c7096-a776-48b4-bbd5-65f9ecb1e144) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1358680-3188-4a97-972e-f1b174af7813) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:02 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Volume 9056ae83-813b-47a2-a7bb-c04165bfe073: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9056ae83-813b-47a2-a7bb-c04165bfe073', 'volume_size': 1} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1102244850',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9056ae83-813b-47a2-a7bb-c04165bfe073,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='ca12c3e9441f465abc9ca02e6c7fa133',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:02Z,use_quota=True,user_id='dd5accf06bcd4efb8aeb5c71a7a9d75e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Creating volume 9056ae83-813b-47a2-a7bb-c04165bfe073 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:02 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:02 devstack sudo[103042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 1073741824 Sep 03 12:06:02 devstack sudo[103042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:02 devstack sudo[103040]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb 1G" returned: 0 in 0.451s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Downloaded image d361786d-95e3-45fa-a71f-c1d3d10120fd ((None, [{'url': 'file:///opt/stack/data/glance/images/d361786d-95e3-45fa-a71f-c1d3d10120fd', 'metadata': {}}])) to volume c71b3d99-a862-4f12-8e74-0932839d2ecb successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Temporary image d361786d-95e3-45fa-a71f-c1d3d10120fd for user ef9ff3074e0340b2a484e7cf24f8bd2a is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Marking volume c71b3d99-a862-4f12-8e74-0932839d2ecb as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Copying metadata from image d361786d-95e3-45fa-a71f-c1d3d10120fd to c71b3d99-a862-4f12-8e74-0932839d2ecb. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Creating volume glance metadata for volume c71b3d99-a862-4f12-8e74-0932839d2ecb backed by image d361786d-95e3-45fa-a71f-c1d3d10120fd with: {'image_id': 'd361786d-95e3-45fa-a71f-c1d3d10120fd', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c2adbc7c76ccf1a9fc8d1ff1d49cffdb', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e29adce4-2af0-4a23-a08e-5fe483ffb251) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c71b3d99-a862-4f12-8e74-0932839d2ecb', 'volume_size': 1, 'image_id': 'd361786d-95e3-45fa-a71f-c1d3d10120fd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d361786d-95e3-45fa-a71f-c1d3d10120fd', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c2adbc7c76ccf1a9fc8d1ff1d49cffdb', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '187ffe395f764e89884f28d50c187220', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'c29babfa766cd3b509afd3e86e388da0976e7eabf5b693dd8f6ef3293d3ed32c1321c299640e2261ceba9fba1eb06015c0208967f4a2e0a49f1d6f37b4276490', 'id': 'd361786d-95e3-45fa-a71f-c1d3d10120fd', 'created_at': datetime.datetime(2026, 9, 3, 10, 5, 51, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 5, 53, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d361786d-95e3-45fa-a71f-c1d3d10120fd/file', 'properties': {}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf1cf1e-aab1-4f7d-95d9-b6bed8d61f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:02 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Volume volume-c71b3d99-a862-4f12-8e74-0932839d2ecb (c71b3d99-a862-4f12-8e74-0932839d2ecb): created successfully Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cdf1cf1e-aab1-4f7d-95d9-b6bed8d61f94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Flow 'volume_create_manager' (0e7c7e06-86b2-4cf1-a453-b1b8f24385a8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-30cff3f7-5c67-4105-b8ad-4f5ea3b56ef6 tempest-VolumeImageDependencyTests-1997626059 None] Created volume successfully. Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 1073741824" returned: 0 in 0.611s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:03 devstack sudo[103042]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:03 devstack sudo[103053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 Sep 03 12:06:03 devstack sudo[103053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Acquiring lock "cinder-c71b3d99-a862-4f12-8e74-0932839d2ecb-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Lock "cinder-c71b3d99-a862-4f12-8e74-0932839d2ecb-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Acquiring lock "cinder-quobyte-c71b3d99-a862-4f12-8e74-0932839d2ecb" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Lock "cinder-quobyte-c71b3d99-a862-4f12-8e74-0932839d2ecb" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[96d1e948-694d-4452-9688-2950c009c98a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:03 devstack sudo[103053]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073" returned: 0 in 0.410s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] <== create_volume: return (1079ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1358680-3188-4a97-972e-f1b174af7813) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9056ae83-813b-47a2-a7bb-c04165bfe073', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf13fa4d-e9dd-4236-bafb-bda6018cfe81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:03 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Volume volume-9056ae83-813b-47a2-a7bb-c04165bfe073 (9056ae83-813b-47a2-a7bb-c04165bfe073): created successfully Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf13fa4d-e9dd-4236-bafb-bda6018cfe81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:03 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Flow 'volume_create_manager' (f1da3f90-5390-49b5-84e0-a162dd990c0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a17b4c8c-3a21-48fb-9f32-9d95d66a9357 tempest-VolumesListTestJSON-1475331933 None] Created volume successfully. Sep 03 12:06:03 devstack sudo[103056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb Sep 03 12:06:03 devstack sudo[103056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:04 devstack sudo[103056]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb" returned: 0 in 0.506s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:04 devstack sudo[103073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb Sep 03 12:06:04 devstack sudo[103073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:04 devstack sudo[103073]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c71b3d99-a862-4f12-8e74-0932839d2ecb" returned: 0 in 0.710s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Lock "cinder-quobyte-c71b3d99-a862-4f12-8e74-0932839d2ecb" released by "delete_volume" :: held 1.313s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:05 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Created reservations ['69f864fb-0641-4af3-aac8-6482ca8df34b', '6b4c8c32-0a2b-431e-8191-248a067ed755', '713ff1da-3bb7-4abb-ae8d-b72a6a3b7066', 'fb9464d8-4aa5-46ab-b049-52cb28dd17c1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:05 devstack sudo[103123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:05 devstack sudo[103123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:06 devstack sudo[103123]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.936s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:06 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Deleted volume successfully. Sep 03 12:06:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-cf6a3a75-88b8-439d-b737-df3eb81ae871 tempest-VolumeImageDependencyTests-1997626059 None] Lock "cinder-c71b3d99-a862-4f12-8e74-0932839d2ecb-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "cinder-9056ae83-813b-47a2-a7bb-c04165bfe073-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-9056ae83-813b-47a2-a7bb-c04165bfe073-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "cinder-quobyte-9056ae83-813b-47a2-a7bb-c04165bfe073" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-quobyte-9056ae83-813b-47a2-a7bb-c04165bfe073" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[351635d1-8331-4e52-ac35-aadc75ca92c0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:09 devstack sudo[103138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 Sep 03 12:06:09 devstack sudo[103138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:09 devstack sudo[103138]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073" returned: 0 in 0.655s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:10 devstack sudo[103143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073 Sep 03 12:06:10 devstack sudo[103143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:10 devstack sudo[103143]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9056ae83-813b-47a2-a7bb-c04165bfe073" returned: 0 in 0.605s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-quobyte-9056ae83-813b-47a2-a7bb-c04165bfe073" released by "delete_volume" :: held 1.328s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Created reservations ['15f4d2b2-f7e5-4fb7-94c4-4b49fe39abee', '84764b31-8e4b-4d88-afa2-145fe9848e7d', '00106d3a-cf64-4ed5-b204-20b2d6967b64', '6ed1c6ff-d5bf-432c-9af7-8a430dcfc5f5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:10 devstack sudo[103146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:10 devstack sudo[103146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:11 devstack sudo[103146]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.653s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Deleted volume successfully. Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5de6e47d-f96e-43fb-b97f-5a0f044928c1 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-9056ae83-813b-47a2-a7bb-c04165bfe073-delete_volume" released by "delete_volume" :: held 2.410s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "cinder-6bbd27e2-962f-40e9-b53b-fd11790b4955-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-6bbd27e2-962f-40e9-b53b-fd11790b4955-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "cinder-quobyte-6bbd27e2-962f-40e9-b53b-fd11790b4955" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-quobyte-6bbd27e2-962f-40e9-b53b-fd11790b4955" acquired by "delete_volume" :: waited 0.039s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1809af85-2382-4d6c-9459-d94f9f9c40e2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:12 devstack sudo[103151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 Sep 03 12:06:12 devstack sudo[103151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Flow 'volume_create_manager' (4d1c88df-c562-4dea-9dee-01a97dd5dd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c09f95-92e8-4d74-83cd-62d1d89d310f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (79c09f95-92e8-4d74-83cd-62d1d89d310f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb206889b3c742b983ad243f19ff9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:12Z,use_quota=True,user_id='e6424d6251ce4f959e1ea711e7fc323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56ea03c-c3ef-40c3-a3b3-9fda0a7d00ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a56ea03c-c3ef-40c3-a3b3-9fda0a7d00ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a1c771-ae56-4744-8e9e-b8a0660485e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (84a1c771-ae56-4744-8e9e-b8a0660485e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce', 'volume_name': 'volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99577784-2e6b-4943-96bc-d758dcf697e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (99577784-2e6b-4943-96bc-d758dcf697e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8afd2e-d516-4587-a052-fe570611f512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:12 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Volume 6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce', 'volume_size': 1} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:11Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb206889b3c742b983ad243f19ff9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:12Z,use_quota=True,user_id='e6424d6251ce4f959e1ea711e7fc323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Creating volume 6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:12 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:12 devstack sudo[103153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce 1073741824 Sep 03 12:06:12 devstack sudo[103153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:12 devstack sudo[103151]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955" returned: 0 in 0.560s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:12 devstack sudo[103158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955 Sep 03 12:06:12 devstack sudo[103158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:13 devstack sudo[103158]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6bbd27e2-962f-40e9-b53b-fd11790b4955" returned: 0 in 0.530s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-quobyte-6bbd27e2-962f-40e9-b53b-fd11790b4955" released by "delete_volume" :: held 1.172s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:13 devstack sudo[103153]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce 1073741824" returned: 0 in 0.771s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Created reservations ['bf6b553c-0678-4cfb-b84e-105ea21d6870', 'be64ebc7-70f7-4534-840d-8956080510bc', '23b808de-492f-4230-b51d-f6c8b0e0aed6', 'e9bead85-57ba-4cbf-99a3-dcff2cbb163e'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:13 devstack sudo[103166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce Sep 03 12:06:13 devstack sudo[103166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:13 devstack sudo[103169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:13 devstack sudo[103169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:13 devstack sudo[103166]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce" returned: 0 in 0.329s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] <== create_volume: return (1177ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.183s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7f8afd2e-d516-4587-a052-fe570611f512) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed11de12-8e45-4761-96bb-1b92df656410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:13 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Volume volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce (6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce): created successfully Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed11de12-8e45-4761-96bb-1b92df656410) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Flow 'volume_create_manager' (4d1c88df-c562-4dea-9dee-01a97dd5dd91) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:13 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c312adc1-141a-4a18-b8aa-9f5b92c5149a tempest-CinderUnicodeTest-611343102 None] Created volume successfully. Sep 03 12:06:13 devstack sudo[103169]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.315s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:13 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Deleted volume successfully. Sep 03 12:06:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8b5e8218-ef6f-4abe-aa06-1b46870f7a26 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-6bbd27e2-962f-40e9-b53b-fd11790b4955-delete_volume" released by "delete_volume" :: held 1.903s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "cinder-55e31386-3491-49d9-9f54-28ca77b9f2a3-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-55e31386-3491-49d9-9f54-28ca77b9f2a3-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "cinder-quobyte-55e31386-3491-49d9-9f54-28ca77b9f2a3" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-quobyte-55e31386-3491-49d9-9f54-28ca77b9f2a3" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f20386e6-589d-4abd-a1fc-6921a3eaeb8f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:14 devstack sudo[103202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 Sep 03 12:06:14 devstack sudo[103202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:14 devstack sudo[103202]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3" returned: 0 in 0.463s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:14 devstack sudo[103207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3 Sep 03 12:06:14 devstack sudo[103207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Flow 'volume_create_manager' (a57f887c-3c23-4b14-af96-a3590869a2e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b178e945-18c1-4312-aeff-d8b73c911e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b178e945-18c1-4312-aeff-d8b73c911e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-431002559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c02a4b9-b430-4bd3-8825-49469afb1f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb206889b3c742b983ad243f19ff9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:15Z,use_quota=True,user_id='e6424d6251ce4f959e1ea711e7fc323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358bc8b4-249a-4b3e-bc7f-b5e87a6fbaca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (358bc8b4-249a-4b3e-bc7f-b5e87a6fbaca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd19d1a3-f4c2-4e0d-be4f-bec575ecee1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd19d1a3-f4c2-4e0d-be4f-bec575ecee1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c02a4b9-b430-4bd3-8825-49469afb1f30', 'volume_name': 'volume-8c02a4b9-b430-4bd3-8825-49469afb1f30', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8a202c-ad82-4633-8617-c554dbbe5b24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d8a202c-ad82-4633-8617-c554dbbe5b24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5030fe80-95e8-4ad2-a5a2-22b906871671) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:14 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Volume 8c02a4b9-b430-4bd3-8825-49469afb1f30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c02a4b9-b430-4bd3-8825-49469afb1f30', 'volume_size': 1} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:14Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-431002559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c02a4b9-b430-4bd3-8825-49469afb1f30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb206889b3c742b983ad243f19ff9873',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:15Z,use_quota=True,user_id='e6424d6251ce4f959e1ea711e7fc323d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Creating volume 8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:14 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:14 devstack sudo[103209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 1073741824 Sep 03 12:06:14 devstack sudo[103209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:14 devstack sudo[103207]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-55e31386-3491-49d9-9f54-28ca77b9f2a3" returned: 0 in 0.286s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-quobyte-55e31386-3491-49d9-9f54-28ca77b9f2a3" released by "delete_volume" :: held 0.791s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Created reservations ['2f93b213-7dc1-4327-a927-08519e0d4772', 'af04c9ec-9d33-440d-b175-a0a830393f42', '8149f432-5fbe-4998-a376-1911c7ba8fe4', 'c7503836-151c-47d9-8f4d-e604e734fa51'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:15 devstack sudo[103215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:15 devstack sudo[103215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:15 devstack sudo[103209]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 1073741824" returned: 0 in 0.529s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:15 devstack sudo[103215]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Deleted volume successfully. Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:15 devstack sudo[103219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b853a32c-ca92-46ef-bcbe-aedd3179d8b0 tempest-VolumesListTestJSON-1475331933 None] Lock "cinder-55e31386-3491-49d9-9f54-28ca77b9f2a3-delete_volume" released by "delete_volume" :: held 1.323s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:15 devstack sudo[103219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:15 devstack sudo[103219]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30" returned: 0 in 0.281s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5030fe80-95e8-4ad2-a5a2-22b906871671) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c02a4b9-b430-4bd3-8825-49469afb1f30', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e4b03c-a4c2-4923-9644-06d73e5077e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Volume volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 (8c02a4b9-b430-4bd3-8825-49469afb1f30): created successfully Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a2e4b03c-a4c2-4923-9644-06d73e5077e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Flow 'volume_create_manager' (a57f887c-3c23-4b14-af96-a3590869a2e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1bb0ea73-f23a-4658-89be-0e8567c3aee7 tempest-CinderUnicodeTest-611343102 None] Created volume successfully. Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:16 devstack sudo[103223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:16 devstack sudo[103223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:16 devstack sudo[103223]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.269s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 28 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:06:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:06:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Creating offline snapshot 79fb2c27-f015-4be7-b894-95a3df24e156 of volume 8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:06:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c229fb11-116d-44e9-a5bb-d0b22417b396]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:17 devstack sudo[103226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 Sep 03 12:06:17 devstack sudo[103226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:17 devstack sudo[103226]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30" returned: 0 in 0.410s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:17 devstack sudo[103231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 1G Sep 03 12:06:17 devstack sudo[103231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:18 devstack sudo[103231]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 1G" returned: 0 in 0.512s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:18 devstack sudo[103237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 Sep 03 12:06:18 devstack sudo[103237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:18 devstack sudo[103237]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156" returned: 0 in 0.354s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:18 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 is being set with open permissions: ugo+rw Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:18 devstack sudo[103242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 Sep 03 12:06:18 devstack sudo[103242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Flow 'volume_create_manager' (7ad10070-a180-46b3-abb1-32ce7369ab7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb275e06-f169-4ceb-ab1c-b85a57bc7e90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb275e06-f169-4ceb-ab1c-b85a57bc7e90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1654232898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb4ac0-9fdf-467c-9040-8377d63e35c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba20a1fc990492a925a48060e58212c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:19Z,use_quota=True,user_id='6093ba717df04ca7afe16253dce6d19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d77570b-36f2-4b74-ab3b-3b02796e32af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d77570b-36f2-4b74-ab3b-3b02796e32af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88efa3e-ae6e-448a-8fd1-2b2e262a6d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c88efa3e-ae6e-448a-8fd1-2b2e262a6d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4bb4ac0-9fdf-467c-9040-8377d63e35c5', 'volume_name': 'volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5', 'volume_size': 2}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2ef801-dbd2-42a6-8bb6-92ac3a41c768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb2ef801-dbd2-42a6-8bb6-92ac3a41c768) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6781d32d-c387-48d7-aea8-e2c8cca37c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Volume f4bb4ac0-9fdf-467c-9040-8377d63e35c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5', 'volume_size': 2} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:18 devstack sudo[103242]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156" returned: 0 in 0.317s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:18 devstack sudo[103245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.info Sep 03 12:06:18 devstack sudo[103245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:19 devstack sudo[103245]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.info" returned: 0 in 0.256s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:19 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.info is being set with open permissions: ugo+rw Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:19 devstack sudo[103248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.info Sep 03 12:06:19 devstack sudo[103248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:19 devstack sudo[103248]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.info" returned: 0 in 0.274s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.219s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.597s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-1654232898',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4bb4ac0-9fdf-467c-9040-8377d63e35c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eba20a1fc990492a925a48060e58212c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:19Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:19Z,use_quota=True,user_id='6093ba717df04ca7afe16253dce6d19b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Creating volume f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:19 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 2147483648 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:19 devstack sudo[103251]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 2147483648 Sep 03 12:06:19 devstack sudo[103251]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5b35772c-b7af-43aa-aff2-a57cacd84134 tempest-CinderUnicodeTest-611343102 None] Create snapshot completed successfully Sep 03 12:06:19 devstack sudo[103251]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 2147483648" returned: 0 in 0.630s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:20 devstack sudo[103259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 Sep 03 12:06:20 devstack sudo[103259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:20 devstack sudo[103259]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" returned: 0 in 0.295s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] <== create_volume: return (970ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.974s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6781d32d-c387-48d7-aea8-e2c8cca37c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5', 'volume_size': 2}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148547bd-5c26-4332-9460-2a0295501ad8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "cinder-79fb2c27-f015-4be7-b894-95a3df24e156-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:20 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Volume volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 (f4bb4ac0-9fdf-467c-9040-8377d63e35c5): created successfully Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (148547bd-5c26-4332-9460-2a0295501ad8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Flow 'volume_create_manager' (7ad10070-a180-46b3-abb1-32ce7369ab7d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-79fb2c27-f015-4be7-b894-95a3df24e156-delete_snapshot" acquired by "delete_snapshot" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "cinder-quobyte-8c02a4b9-b430-4bd3-8825-49469afb1f30" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2b20a10e-93d6-487e-9121-a3a5961bd5c8 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Created volume successfully. Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-8c02a4b9-b430-4bd3-8825-49469afb1f30" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "cinder-quobyte-79fb2c27-f015-4be7-b894-95a3df24e156" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-79fb2c27-f015-4be7-b894-95a3df24e156" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Deleting offline snapshot 79fb2c27-f015-4be7-b894-95a3df24e156 of volume 8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] snapshot_file for this snap is: volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c1b71fe-512e-4c56-bd5e-682f81bd1e18]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:20 devstack sudo[103278]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 Sep 03 12:06:20 devstack sudo[103278]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:20 devstack sudo[103278]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156" returned: 0 in 0.406s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c02a4b9-b430-4bd3-8825-49469afb1f30(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[959e0f02-6c04-4693-a400-25c254d010f3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Creating offline snapshot 6a083147-760e-4e46-bffc-20f1ec3f564b of volume f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2d363a8-9471-4081-a755-7a0ce27e943e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:21 devstack sudo[103283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 Sep 03 12:06:21 devstack sudo[103283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:21 devstack sudo[103284]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 Sep 03 12:06:21 devstack sudo[103284]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:21 devstack sudo[103283]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30" returned: 0 in 0.389s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:21 devstack sudo[103290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 Sep 03 12:06:21 devstack sudo[103290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:21 devstack sudo[103284]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" returned: 0 in 0.391s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b 2G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:21 devstack sudo[103295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b 2G Sep 03 12:06:21 devstack sudo[103295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:21 devstack sudo[103290]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156" returned: 0 in 0.328s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:21 devstack sudo[103300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156 Sep 03 12:06:21 devstack sudo[103300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:21 devstack sudo[103295]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b 2G" returned: 0 in 0.411s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:21 devstack sudo[103305]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b Sep 03 12:06:21 devstack sudo[103305]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:21 devstack sudo[103300]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30.79fb2c27-f015-4be7-b894-95a3df24e156" returned: 0 in 0.269s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-79fb2c27-f015-4be7-b894-95a3df24e156" released by "_delete_snapshot" :: held 1.519s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-8c02a4b9-b430-4bd3-8825-49469afb1f30" released by "delete_snapshot" :: held 1.546s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Created reservations ['c47c895b-b39a-4230-8fa3-fbc4894aba63', '4fab40c7-31ac-4d16-9fd2-872c9217ed82', '57c6fa5b-68cb-4652-9819-619e9d7f5533', '35e9dd53-6b01-4fa4-929e-48f9a9a83e63'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Delete snapshot completed successfully. Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b08e78a-fd90-4f72-8fe0-f117dc6a3786 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-79fb2c27-f015-4be7-b894-95a3df24e156-delete_snapshot" released by "delete_snapshot" :: held 1.719s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:22 devstack sudo[103305]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b" returned: 0 in 0.301s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:22 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b is being set with open permissions: ugo+rw Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:22 devstack sudo[103311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b Sep 03 12:06:22 devstack sudo[103311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:22 devstack sudo[103311]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b" returned: 0 in 0.252s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:22 devstack sudo[103314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.info Sep 03 12:06:22 devstack sudo[103314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Acquiring lock "cinder-8c02a4b9-b430-4bd3-8825-49469afb1f30-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Lock "cinder-8c02a4b9-b430-4bd3-8825-49469afb1f30-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Acquiring lock "cinder-quobyte-8c02a4b9-b430-4bd3-8825-49469afb1f30" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-8c02a4b9-b430-4bd3-8825-49469afb1f30" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[eebdf63d-a946-47cf-a2cd-c13e316f2a91]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:22 devstack sudo[103314]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.info" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:22 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.info is being set with open permissions: ugo+rw Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:22 devstack sudo[103318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.info Sep 03 12:06:22 devstack sudo[103318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:22 devstack sudo[103317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 Sep 03 12:06:22 devstack sudo[103317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:22 devstack sudo[103318]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.info" returned: 0 in 0.287s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:22 devstack sudo[103317]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30" returned: 0 in 0.365s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:23 devstack sudo[103327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30 Sep 03 12:06:23 devstack sudo[103327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-551c7dae-6dc7-4a41-8bb9-cf9d01ce6cf0 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Create snapshot completed successfully Sep 03 12:06:23 devstack sudo[103327]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8c02a4b9-b430-4bd3-8825-49469afb1f30" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-8c02a4b9-b430-4bd3-8825-49469afb1f30" released by "delete_volume" :: held 0.671s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Created reservations ['dbce39f7-fb3a-424f-9aff-10066ed2f800', 'ad8e8e52-bb5d-4dd5-9b4f-8d3c07bc05c7', 'd36c89d9-7186-4b5c-8867-e7b1354d70e8', 'a089b5ac-d864-40aa-9b2f-3fb8c5746443'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=135,cinder:INSERT=57,cinder:UPDATE=162,cinder:DELETE=16 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:23 devstack sudo[103330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:23 devstack sudo[103330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:23 devstack sudo[103330]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Deleted volume successfully. Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-09b9d142-42df-4e41-915c-6042a7f559ad tempest-CinderUnicodeTest-611343102 None] Lock "cinder-8c02a4b9-b430-4bd3-8825-49469afb1f30-delete_volume" released by "delete_volume" :: held 1.113s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "cinder-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "cinder-quobyte-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9265564f-4fe4-4f23-b25b-05fd304816fe]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:23 devstack sudo[103334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce Sep 03 12:06:23 devstack sudo[103334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:24 devstack sudo[103334]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce" returned: 0 in 0.362s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:24 devstack sudo[103340]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce Sep 03 12:06:24 devstack sudo[103340]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "cinder-6a083147-760e-4e46-bffc-20f1ec3f564b-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-6a083147-760e-4e46-bffc-20f1ec3f564b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "cinder-quobyte-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-quobyte-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "cinder-quobyte-6a083147-760e-4e46-bffc-20f1ec3f564b" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-quobyte-6a083147-760e-4e46-bffc-20f1ec3f564b" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Deleting offline snapshot 6a083147-760e-4e46-bffc-20f1ec3f564b of volume f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] snapshot_file for this snap is: volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[21c8ade7-e1f3-4545-8de2-612a62c9a9aa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:24 devstack sudo[103340]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-quobyte-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce" released by "delete_volume" :: held 0.684s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:24 devstack sudo[103342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b Sep 03 12:06:24 devstack sudo[103342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Created reservations ['f6a83a03-2547-44ff-ac9e-1de582552892', '2a0c4339-37e4-4933-9ec7-7496588da114', '20de2887-b721-4fc6-ad5e-5f3100e9ed86', '56f93012-60b8-42b1-9fea-dab271b2d01c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:24 devstack sudo[103345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:24 devstack sudo[103345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:24 devstack sudo[103342]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b" returned: 0 in 0.376s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed3533b9-b95c-4bb2-ae46-a11c88fdd129]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:24 devstack sudo[103345]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.282s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Deleted volume successfully. Sep 03 12:06:24 devstack sudo[103350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 Sep 03 12:06:24 devstack sudo[103350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-67f4230f-4e17-422b-93c7-42eefe60b1a6 tempest-CinderUnicodeTest-611343102 None] Lock "cinder-6dbe0b2e-2ef0-4057-b4d7-b6e98f09f2ce-delete_volume" released by "delete_volume" :: held 1.167s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:25 devstack sudo[103350]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" returned: 0 in 0.379s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:25 devstack sudo[103356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b Sep 03 12:06:25 devstack sudo[103356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:25 devstack sudo[103356]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:25 devstack sudo[103362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b Sep 03 12:06:25 devstack sudo[103362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:25 devstack sudo[103362]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5.6a083147-760e-4e46-bffc-20f1ec3f564b" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-quobyte-6a083147-760e-4e46-bffc-20f1ec3f564b" released by "_delete_snapshot" :: held 1.484s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-quobyte-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" released by "delete_snapshot" :: held 1.509s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Created reservations ['7f6f45ec-6da6-42c8-b51d-b727210f8252', 'ab7d2c8c-80e6-4bb7-85a5-8995d161daf3', 'c9b3b4ad-7dfc-4bf9-9819-2b09e10dadb7', 'bda616b9-33b9-481d-8132-2b929947504c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Delete snapshot completed successfully. Sep 03 12:06:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0a63dade-4c28-486f-a858-96a55ecc101e tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-6a083147-760e-4e46-bffc-20f1ec3f564b-delete_snapshot" released by "delete_snapshot" :: held 1.659s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "cinder-f4bb4ac0-9fdf-467c-9040-8377d63e35c5-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-f4bb4ac0-9fdf-467c-9040-8377d63e35c5-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "cinder-quobyte-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-quobyte-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" acquired by "delete_volume" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e24ea2a5-3a2e-4c42-9be3-f1e65216b624]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:26 devstack sudo[103365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 Sep 03 12:06:26 devstack sudo[103365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:27 devstack sudo[103365]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" returned: 0 in 0.441s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:27 devstack sudo[103370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5 Sep 03 12:06:27 devstack sudo[103370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:27 devstack sudo[103370]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-quobyte-f4bb4ac0-9fdf-467c-9040-8377d63e35c5" released by "delete_volume" :: held 0.779s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Created reservations ['c0794495-c334-4a59-b03c-e516628d9a40', 'db22c33e-42de-4a33-a37e-9c68729f30a4', '061f6135-1723-4b63-9e15-dbcf87f03937', '36df12ff-0074-4295-b04c-454236188300'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:27 devstack sudo[103373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:27 devstack sudo[103373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:27 devstack sudo[103373]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.266s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Deleted volume successfully. Sep 03 12:06:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e3a9f86b-1427-4380-8a6f-05dbcc9ef9f6 tempest-VolumesSnapshotNegativeTestJSON-153282026 None] Lock "cinder-f4bb4ac0-9fdf-467c-9040-8377d63e35c5-delete_volume" released by "delete_volume" :: held 1.301s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Flow 'volume_create_manager' (a38f66ff-7e19-423d-8a25-4ea08e9d0144) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e224bac-c5ee-4e50-b9a6-75ea3ac1562c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e224bac-c5ee-4e50-b9a6-75ea3ac1562c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648483456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de859b0e-aaff-43e7-99a6-71352ea83168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c653b72fc40908de1e7a114efee3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:29Z,use_quota=True,user_id='bde12ad645ac4fe893d1574de95263ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77379ef-88fd-425e-af82-d893508d205b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a77379ef-88fd-425e-af82-d893508d205b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eb967f-cd85-44d7-a404-7188ef062fbd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50eb967f-cd85-44d7-a404-7188ef062fbd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'de859b0e-aaff-43e7-99a6-71352ea83168', 'volume_name': 'volume-de859b0e-aaff-43e7-99a6-71352ea83168', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1efd347-65a0-4c5b-a14e-e6b9f28f8579) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c1efd347-65a0-4c5b-a14e-e6b9f28f8579) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3faf61-bad6-4938-a902-44c29eb8674e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Volume de859b0e-aaff-43e7-99a6-71352ea83168: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-de859b0e-aaff-43e7-99a6-71352ea83168', 'volume_size': 1} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1648483456',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=de859b0e-aaff-43e7-99a6-71352ea83168,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c653b72fc40908de1e7a114efee3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:29Z,use_quota=True,user_id='bde12ad645ac4fe893d1574de95263ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Creating volume de859b0e-aaff-43e7-99a6-71352ea83168 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:29 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:29 devstack sudo[103412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 1073741824 Sep 03 12:06:29 devstack sudo[103412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:29 devstack sudo[103412]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 1073741824" returned: 0 in 0.474s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:29 devstack sudo[103417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 Sep 03 12:06:29 devstack sudo[103417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:29 devstack sudo[103417]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168" returned: 0 in 0.247s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] <== create_volume: return (768ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3faf61-bad6-4938-a902-44c29eb8674e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-de859b0e-aaff-43e7-99a6-71352ea83168', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda3c6fb-04e2-4ce0-a3d2-7f28b63fd77a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Volume volume-de859b0e-aaff-43e7-99a6-71352ea83168 (de859b0e-aaff-43e7-99a6-71352ea83168): created successfully Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eda3c6fb-04e2-4ce0-a3d2-7f28b63fd77a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Flow 'volume_create_manager' (a38f66ff-7e19-423d-8a25-4ea08e9d0144) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a12be263-c30f-4098-a539-aae364afac64 tempest-ProjectReaderTests-649297896 None] Created volume successfully. Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Acquiring lock "cinder-de859b0e-aaff-43e7-99a6-71352ea83168-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Lock "cinder-de859b0e-aaff-43e7-99a6-71352ea83168-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Acquiring lock "cinder-quobyte-de859b0e-aaff-43e7-99a6-71352ea83168" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Lock "cinder-quobyte-de859b0e-aaff-43e7-99a6-71352ea83168" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6bf16bc4-5014-4632-88d0-4803ec8ab9ea]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:31 devstack sudo[103420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 Sep 03 12:06:31 devstack sudo[103420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:31 devstack sudo[103420]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168" returned: 0 in 0.339s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:31 devstack sudo[103425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168 Sep 03 12:06:31 devstack sudo[103425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:31 devstack sudo[103425]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-de859b0e-aaff-43e7-99a6-71352ea83168" returned: 0 in 0.265s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Lock "cinder-quobyte-de859b0e-aaff-43e7-99a6-71352ea83168" released by "delete_volume" :: held 0.642s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:31 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Created reservations ['8fa115ee-3489-481c-9e61-0ef739cd0527', '62f71c5c-356f-4e4c-83de-c57d373e12d7', '230b2144-1ab4-417d-846f-06fcf6471b8b', 'bcfc13f4-9659-42d5-bc5e-fdcc49906db0'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:32 devstack sudo[103430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:32 devstack sudo[103430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:32 devstack sudo[103430]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Deleted volume successfully. Sep 03 12:06:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-4648257f-c194-4767-bf0d-917ba0e1b665 tempest-ProjectReaderTests-649297896 None] Lock "cinder-de859b0e-aaff-43e7-99a6-71352ea83168-delete_volume" released by "delete_volume" :: held 1.100s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Flow 'volume_create_manager' (1bff6860-381e-4771-8ae6-c0a673179497) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236747aa-e0e1-4608-9df1-80f0523adcaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Flow 'volume_create_manager' (0891dbef-8570-4ec3-96eb-4ffbd2dac0b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a4f391-39bb-49d7-a60d-93893e5cb55c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (236747aa-e0e1-4608-9df1-80f0523adcaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530517394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48925c63-1a6a-4fa9-bc96-6c659b0a7c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c653b72fc40908de1e7a114efee3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:33Z,use_quota=True,user_id='bde12ad645ac4fe893d1574de95263ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d97e46-d098-4b23-92a4-53b7d3b00a65) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (64d97e46-d098-4b23-92a4-53b7d3b00a65) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5536e253-21a1-4df6-86a3-96c6073cf820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5536e253-21a1-4df6-86a3-96c6073cf820) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '48925c63-1a6a-4fa9-bc96-6c659b0a7c3a', 'volume_name': 'volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9173f4e3-e4ec-468e-8b31-6bd96ad47f13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9173f4e3-e4ec-468e-8b31-6bd96ad47f13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f25967-765c-44e7-b9eb-889f5380f5b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Volume 48925c63-1a6a-4fa9-bc96-6c659b0a7c3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a', 'volume_size': 1} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1530517394',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=48925c63-1a6a-4fa9-bc96-6c659b0a7c3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d6c653b72fc40908de1e7a114efee3b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:33Z,use_quota=True,user_id='bde12ad645ac4fe893d1574de95263ac',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Creating volume 48925c63-1a6a-4fa9-bc96-6c659b0a7c3a {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:33 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50a4f391-39bb-49d7-a60d-93893e5cb55c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-60214028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bc46a0-74a2-472d-8cba-6e0565b68c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d08c8a3a3e842edadb0b70eae13dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:33Z,use_quota=True,user_id='ac43818f12ff461c91627f2463c46105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack sudo[103437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a 1073741824 Sep 03 12:06:33 devstack sudo[103437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2cee34-0699-4b99-9e1a-5346a753be59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2cee34-0699-4b99-9e1a-5346a753be59) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2497ef-a989-4cf1-b83c-151c99930dfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab2497ef-a989-4cf1-b83c-151c99930dfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c0bc46a0-74a2-472d-8cba-6e0565b68c9d', 'volume_name': 'volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d0f5b6-9d33-4a0b-9cb1-1904f4f1c617) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3d0f5b6-9d33-4a0b-9cb1-1904f4f1c617) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e42578-abc6-4868-8881-93ba60fd90ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:33 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Volume c0bc46a0-74a2-472d-8cba-6e0565b68c9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d', 'volume_size': 1} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:33 devstack sudo[103437]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a 1073741824" returned: 0 in 0.474s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:33 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a Sep 03 12:06:33 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:34 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] <== create_volume: return (843ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.775s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-60214028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c0bc46a0-74a2-472d-8cba-6e0565b68c9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7d08c8a3a3e842edadb0b70eae13dafe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:33Z,use_quota=True,user_id='ac43818f12ff461c91627f2463c46105',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Creating volume c0bc46a0-74a2-472d-8cba-6e0565b68c9d {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:34 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26f25967-765c-44e7-b9eb-889f5380f5b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7867b612-2c49-4c1c-9f9b-e062a7321b1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:34 devstack sudo[103450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d 1073741824 Sep 03 12:06:34 devstack sudo[103450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:34 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Volume volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a (48925c63-1a6a-4fa9-bc96-6c659b0a7c3a): created successfully Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7867b612-2c49-4c1c-9f9b-e062a7321b1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Flow 'volume_create_manager' (1bff6860-381e-4771-8ae6-c0a673179497) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5998271e-6248-4787-baa1-2fe51e7ad191 tempest-ProjectReaderTests-649297896 None] Created volume successfully. Sep 03 12:06:34 devstack sudo[103450]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d 1073741824" returned: 0 in 0.674s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:34 devstack sudo[103477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d Sep 03 12:06:34 devstack sudo[103477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:35 devstack sudo[103477]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d" returned: 0 in 0.338s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] <== create_volume: return (1070ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.072s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Acquiring lock "cinder-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9e42578-abc6-4868-8881-93ba60fd90ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fde78df-6bb1-4da3-86cf-d8b9bc36bf97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Lock "cinder-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:35 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Volume volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d (c0bc46a0-74a2-472d-8cba-6e0565b68c9d): created successfully Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fde78df-6bb1-4da3-86cf-d8b9bc36bf97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Flow 'volume_create_manager' (0891dbef-8570-4ec3-96eb-4ffbd2dac0b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9ca52bb7-9214-4691-bf94-58b550186863 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Created volume successfully. Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Acquiring lock "cinder-quobyte-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Lock "cinder-quobyte-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a" acquired by "delete_volume" :: waited 0.051s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[65049a25-d58e-4458-be4b-f36daaeffb59]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:35 devstack sudo[103482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a Sep 03 12:06:35 devstack sudo[103482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-d5b9025f-2a27-4247-a21c-3227ff6d274e tempest-TestShelveInstance-1166583260 None] Terminate volume connection completed successfully. Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-d5b9025f-2a27-4247-a21c-3227ff6d274e tempest-TestShelveInstance-1166583260 None] Deleting attachment b5a5c333-fd8d-4060-b8f6-a9f4f018eb6a. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Acquiring lock "cinder-7dc412e6-8587-4625-bab3-3d5332453b4b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Lock "cinder-7dc412e6-8587-4625-bab3-3d5332453b4b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Acquiring lock "cinder-quobyte-7dc412e6-8587-4625-bab3-3d5332453b4b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Lock "cinder-quobyte-7dc412e6-8587-4625-bab3-3d5332453b4b" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[4241086b-5e89-419d-b274-f5a2ff570783]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:35 devstack sudo[103482]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a" returned: 0 in 0.400s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:35 devstack sudo[103488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a Sep 03 12:06:35 devstack sudo[103488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:35 devstack sudo[103487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b Sep 03 12:06:35 devstack sudo[103487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:36 devstack sudo[103488]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a" returned: 0 in 0.312s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Lock "cinder-quobyte-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a" released by "delete_volume" :: held 0.797s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Created reservations ['870e400c-ac9f-4538-b66a-49938c88e232', '6eed3454-9ded-47d2-b8e0-6178856628d9', 'e2ae5dba-3625-4cb8-8475-4f3f78df97fd', 'b5a624ca-7cb3-480f-9260-d3bd97d77e30'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:36 devstack sudo[103487]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b" returned: 0 in 0.557s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:36 devstack sudo[103498]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b Sep 03 12:06:36 devstack sudo[103498]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:36 devstack sudo[103500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:36 devstack sudo[103500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:36 devstack sudo[103498]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7dc412e6-8587-4625-bab3-3d5332453b4b" returned: 0 in 0.458s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Lock "cinder-quobyte-7dc412e6-8587-4625-bab3-3d5332453b4b" released by "delete_volume" :: held 1.086s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:36 devstack sudo[103500]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.421s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Deleted volume successfully. Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-13c7730b-c03f-4115-9732-78a70aea00d5 tempest-ProjectReaderTests-649297896 None] Lock "cinder-48925c63-1a6a-4fa9-bc96-6c659b0a7c3a-delete_volume" released by "delete_volume" :: held 1.737s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:36 devstack cinder-volume[87256]: DEBUG cinder.quota [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Created reservations ['69f949f4-7178-47d8-b313-f315f7a9c5fd', 'd63e0e1e-e609-4c6c-9715-efb52e68a268', 'bacce8bb-be67-46e6-aa65-cd77a7c61e8b', 'ad031818-a3f4-45d0-bc09-f5d1f45edb81'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:37 devstack sudo[103512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:37 devstack sudo[103512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-562d3a02-a614-43f8-b3e0-968a18082e7d req-8a09271a-8dd6-4d5b-9959-598343eb9b65 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-562d3a02-a614-43f8-b3e0-968a18082e7d req-8a09271a-8dd6-4d5b-9959-598343eb9b65 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-562d3a02-a614-43f8-b3e0-968a18082e7d req-8a09271a-8dd6-4d5b-9959-598343eb9b65 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.029s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-562d3a02-a614-43f8-b3e0-968a18082e7d req-8a09271a-8dd6-4d5b-9959-598343eb9b65 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '9315aca9-fef3-467e-aaf1-15cd38239d42', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:06:37 devstack sudo[103512]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.396s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG cinder.manager [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:37 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-562d3a02-a614-43f8-b3e0-968a18082e7d req-8a09271a-8dd6-4d5b-9959-598343eb9b65 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] attachment_update completed successfully. Sep 03 12:06:37 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Deleted volume successfully. Sep 03 12:06:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [req-ecc2a9ea-0f8b-4114-8e81-e6cf6346ebd7 req-8bf4b52f-9759-4b67-8819-33569bf74549 tempest-TestShelveInstance-1166583260 None] Lock "cinder-7dc412e6-8587-4625-bab3-3d5332453b4b-delete_volume" released by "delete_volume" :: held 1.816s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:41 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-f9a2062d-f8b9-41f5-a539-16de9ae19714 req-d3261fad-9d1c-4cc5-ba0d-a7dcebe886b4 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Terminate volume connection completed successfully. Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-f9a2062d-f8b9-41f5-a539-16de9ae19714 req-d3261fad-9d1c-4cc5-ba0d-a7dcebe886b4 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Deleting attachment 9315aca9-fef3-467e-aaf1-15cd38239d42. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (8d35b70e-4c61-4b1f-a945-79ae28434db1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe92f0f-d80b-4a95-9f8e-a3379b68c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fe92f0f-d80b-4a95-9f8e-a3379b68c415) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942835213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf8596d-320c-4728-a980-a4fc3a3b6a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:41Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1eb454f-1cf3-4936-86dc-6fdd03ada571) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f1eb454f-1cf3-4936-86dc-6fdd03ada571) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f39ffbd-19c3-4c0c-ae9e-2fc56fcb7a4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f39ffbd-19c3-4c0c-ae9e-2fc56fcb7a4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ccf8596d-320c-4728-a980-a4fc3a3b6a5c', 'volume_name': 'volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d3d85-e81f-41a7-98c1-de6955f8eec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (297d3d85-e81f-41a7-98c1-de6955f8eec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7975859-db45-4b86-b4f1-3ca1fbf6b884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:41 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Volume ccf8596d-320c-4728-a980-a4fc3a3b6a5c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c', 'volume_size': 1} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-942835213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ccf8596d-320c-4728-a980-a4fc3a3b6a5c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:41Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Creating volume ccf8596d-320c-4728-a980-a4fc3a3b6a5c {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:41 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:41 devstack sudo[103932]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c 1073741824 Sep 03 12:06:41 devstack sudo[103932]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Acquiring lock "cinder-c0bc46a0-74a2-472d-8cba-6e0565b68c9d-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "cinder-c0bc46a0-74a2-472d-8cba-6e0565b68c9d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Acquiring lock "cinder-quobyte-c0bc46a0-74a2-472d-8cba-6e0565b68c9d" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "cinder-quobyte-c0bc46a0-74a2-472d-8cba-6e0565b68c9d" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:42 devstack sudo[103932]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c 1073741824" returned: 0 in 0.549s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[85da334d-2358-45c2-a2a3-a88f9159198a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:42 devstack sudo[103939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c Sep 03 12:06:42 devstack sudo[103939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:42 devstack sudo[103938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d Sep 03 12:06:42 devstack sudo[103938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:42 devstack sudo[103939]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c" returned: 0 in 0.376s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.990s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7975859-db45-4b86-b4f1-3ca1fbf6b884) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0d6e96-4ab7-4d49-8dbd-cfcb81f27e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:42 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Volume volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c (ccf8596d-320c-4728-a980-a4fc3a3b6a5c): created successfully Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f0d6e96-4ab7-4d49-8dbd-cfcb81f27e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (8d35b70e-4c61-4b1f-a945-79ae28434db1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c6267c91-9b2f-40d5-81ef-d06ac292d096 tempest-ProjectReaderTests-1304265993 None] Created volume successfully. Sep 03 12:06:42 devstack sudo[103938]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d" returned: 0 in 0.521s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:42 devstack sudo[103947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d Sep 03 12:06:42 devstack sudo[103947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:42 devstack sudo[103947]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c0bc46a0-74a2-472d-8cba-6e0565b68c9d" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "cinder-quobyte-c0bc46a0-74a2-472d-8cba-6e0565b68c9d" released by "delete_volume" :: held 0.885s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:42 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Created reservations ['e362bb3a-d178-4861-b1b4-8c7fbe16055b', 'ca433d84-d6ef-40d7-b57a-c3488444be0f', '96d3e27c-675a-402b-9d7c-6fe8d5b150a4', '216868e0-ea89-4828-8d84-a7b8dd332064'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:43 devstack sudo[103957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:43 devstack sudo[103957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:43 devstack sudo[103957]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.341s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Deleted volume successfully. Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a6e9aada-16ae-469d-9371-cbfd77dcd261 tempest-TestServerVolumeAttachScenarioOldVersion-1432823289 None] Lock "cinder-c0bc46a0-74a2-472d-8cba-6e0565b68c9d-delete_volume" released by "delete_volume" :: held 1.489s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-ccf8596d-320c-4728-a980-a4fc3a3b6a5c-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-ccf8596d-320c-4728-a980-a4fc3a3b6a5c-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-quobyte-ccf8596d-320c-4728-a980-a4fc3a3b6a5c" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-ccf8596d-320c-4728-a980-a4fc3a3b6a5c" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f0e1f1a-3d2a-4070-945b-84c708159c6b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:44 devstack sudo[103981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c Sep 03 12:06:44 devstack sudo[103981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:44 devstack sudo[103981]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c" returned: 0 in 0.420s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:44 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c Sep 03 12:06:44 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:44 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ccf8596d-320c-4728-a980-a4fc3a3b6a5c" returned: 0 in 0.309s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-ccf8596d-320c-4728-a980-a4fc3a3b6a5c" released by "delete_volume" :: held 0.778s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=165,cinder:SELECT=121,cinder:INSERT=28,cinder:DELETE=13 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Created reservations ['c2946a1a-a793-4c56-9a5a-411e5d66a95f', '756df2ec-2504-414b-8003-35f7da3da800', '139cd1f6-7e5b-423f-82e7-87236d20d40a', 'eeb66fd2-9006-4d5c-b5a9-b3973f4e37a5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:45 devstack sudo[103990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:45 devstack sudo[103990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:45 devstack sudo[103990]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.287s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:45 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Deleted volume successfully. Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f85b38c-2657-4599-9589-3e8981444ce7 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-ccf8596d-320c-4728-a980-a4fc3a3b6a5c-delete_volume" released by "delete_volume" :: held 1.317s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (30f98a9e-d47e-4e48-adec-fd1ea2d87e08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e838909-4c08-45fc-8aee-62004f27a02c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e838909-4c08-45fc-8aee-62004f27a02c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825764150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040796e0-8165-4c2c-9bad-a3bcf6540011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:46Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b678c6-b9ee-4c65-a9e2-a5d74c2d61c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74b678c6-b9ee-4c65-a9e2-a5d74c2d61c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c884145-b4cd-4bea-9098-5a8a292010f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3c884145-b4cd-4bea-9098-5a8a292010f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '040796e0-8165-4c2c-9bad-a3bcf6540011', 'volume_name': 'volume-040796e0-8165-4c2c-9bad-a3bcf6540011', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d498f357-cb90-462f-ac3b-40fd7ccd2ded) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d498f357-cb90-462f-ac3b-40fd7ccd2ded) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c11a1-cfbd-419e-8d22-3a55495fa357) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:45 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Volume 040796e0-8165-4c2c-9bad-a3bcf6540011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-040796e0-8165-4c2c-9bad-a3bcf6540011', 'volume_size': 1} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1825764150',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=040796e0-8165-4c2c-9bad-a3bcf6540011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:46Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Creating volume 040796e0-8165-4c2c-9bad-a3bcf6540011 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:45 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:45 devstack sudo[103996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 1073741824 Sep 03 12:06:45 devstack sudo[103996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:46 devstack sudo[103996]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 1073741824" returned: 0 in 0.639s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:46 devstack sudo[104003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 Sep 03 12:06:46 devstack sudo[104003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:46 devstack sudo[104003]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011" returned: 0 in 0.258s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] <== create_volume: return (965ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.967s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8d9c11a1-cfbd-419e-8d22-3a55495fa357) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-040796e0-8165-4c2c-9bad-a3bcf6540011', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47eecec8-be80-4414-b959-8e49c92209d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Volume volume-040796e0-8165-4c2c-9bad-a3bcf6540011 (040796e0-8165-4c2c-9bad-a3bcf6540011): created successfully Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (47eecec8-be80-4414-b959-8e49c92209d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (30f98a9e-d47e-4e48-adec-fd1ea2d87e08) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-be1b2df8-f993-4ffe-b8af-ad6127cbfd67 tempest-ProjectReaderTests-1304265993 None] Created volume successfully. Sep 03 12:06:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-040796e0-8165-4c2c-9bad-a3bcf6540011-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-040796e0-8165-4c2c-9bad-a3bcf6540011-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-quobyte-040796e0-8165-4c2c-9bad-a3bcf6540011" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-040796e0-8165-4c2c-9bad-a3bcf6540011" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:47 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3c3067-2626-453c-a799-61e04c86724a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:48 devstack sudo[104006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 Sep 03 12:06:48 devstack sudo[104006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:48 devstack sudo[104006]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011" returned: 0 in 0.493s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:48 devstack sudo[104011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011 Sep 03 12:06:48 devstack sudo[104011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:48 devstack sudo[104011]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-040796e0-8165-4c2c-9bad-a3bcf6540011" returned: 0 in 0.279s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-040796e0-8165-4c2c-9bad-a3bcf6540011" released by "delete_volume" :: held 0.828s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Created reservations ['03b0e576-18d4-4b51-a082-c2f7759bc3e4', 'afc525c9-efcc-4146-a28d-b7d6abb3ad60', 'bd801984-e4a7-49e8-a40f-414b96229039', 'eeca65e8-eaef-489b-a89b-b7643f45a054'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:48 devstack sudo[104015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:49 devstack sudo[104015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:49 devstack sudo[104015]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.330s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:49 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Deleted volume successfully. Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8f40ba16-4868-4ed0-a7ce-01ffd75419f1 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-040796e0-8165-4c2c-9bad-a3bcf6540011-delete_volume" released by "delete_volume" :: held 1.490s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (e8ad00eb-8e67-4fef-8e5b-001b11d51776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1414c06c-8ebc-4d27-b732-84815af393cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1414c06c-8ebc-4d27-b732-84815af393cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221204925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6c14ef-92e1-48f3-ad79-4dff08f455e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:50Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b09de6-9cf2-4991-94b9-ce91782d28d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8b09de6-9cf2-4991-94b9-ce91782d28d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7c2166-b786-42be-a710-c823bb9fb678) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd7c2166-b786-42be-a710-c823bb9fb678) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9b6c14ef-92e1-48f3-ad79-4dff08f455e0', 'volume_name': 'volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c00808-7072-4d72-a69f-f1ce8191f520) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (47c00808-7072-4d72-a69f-f1ce8191f520) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981b4127-b08e-4106-8c47-1272ca677802) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Volume 9b6c14ef-92e1-48f3-ad79-4dff08f455e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0', 'volume_size': 1} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-221204925',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b6c14ef-92e1-48f3-ad79-4dff08f455e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:50Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Creating volume 9b6c14ef-92e1-48f3-ad79-4dff08f455e0 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:49 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:49 devstack sudo[104018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 1073741824 Sep 03 12:06:49 devstack sudo[104018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:50 devstack sudo[104018]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 1073741824" returned: 0 in 0.495s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:50 devstack sudo[104025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 Sep 03 12:06:50 devstack sudo[104025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:50 devstack sudo[104025]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0" returned: 0 in 0.283s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] <== create_volume: return (835ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.838s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (981b4127-b08e-4106-8c47-1272ca677802) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37e333a-166d-4bda-94e5-63e2e8fc92b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Volume volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 (9b6c14ef-92e1-48f3-ad79-4dff08f455e0): created successfully Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b37e333a-166d-4bda-94e5-63e2e8fc92b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (e8ad00eb-8e67-4fef-8e5b-001b11d51776) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-72461027-9ce9-4de8-84c4-a7e4bad5791d tempest-ProjectReaderTests-1304265993 None] Created volume successfully. Sep 03 12:06:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-9b6c14ef-92e1-48f3-ad79-4dff08f455e0-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-9b6c14ef-92e1-48f3-ad79-4dff08f455e0-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-quobyte-9b6c14ef-92e1-48f3-ad79-4dff08f455e0" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-9b6c14ef-92e1-48f3-ad79-4dff08f455e0" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:51 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6244aa0b-6fa3-4517-b760-9c6f6da1c345]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:52 devstack sudo[104029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 Sep 03 12:06:52 devstack sudo[104029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:52 devstack sudo[104029]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0" returned: 0 in 0.446s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:52 devstack sudo[104034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0 Sep 03 12:06:52 devstack sudo[104034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:52 devstack sudo[104034]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-9b6c14ef-92e1-48f3-ad79-4dff08f455e0" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-9b6c14ef-92e1-48f3-ad79-4dff08f455e0" released by "delete_volume" :: held 0.791s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Created reservations ['a510cc0c-b3b0-40a2-905f-db36d169ad90', 'a8f879a0-8874-4233-971a-df5ef7113cde', '9df3df25-62df-46d0-a437-25c6602955df', '415a2d63-f7e2-4397-a319-0ae06f9ffd56'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:52 devstack sudo[104037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:52 devstack sudo[104037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:53 devstack sudo[104037]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.328s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:53 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Deleted volume successfully. Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9817271f-4506-4852-86f0-a7623c232635 tempest-ProjectReaderTests-1304265993 None] Lock "cinder-9b6c14ef-92e1-48f3-ad79-4dff08f455e0-delete_volume" released by "delete_volume" :: held 1.409s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (de8f1aa7-ac49-46eb-b255-3827090d554e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22facf83-eadc-421a-80fe-1105feb61621) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22facf83-eadc-421a-80fe-1105feb61621) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1982721463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c82602-9bdc-4796-8147-c649046cd746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:53Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9299c0-9048-4a30-9478-48b3f3e1cbab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d9299c0-9048-4a30-9478-48b3f3e1cbab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f500758f-3887-4656-a367-879ca753d54f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f500758f-3887-4656-a367-879ca753d54f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '87c82602-9bdc-4796-8147-c649046cd746', 'volume_name': 'volume-87c82602-9bdc-4796-8147-c649046cd746', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e91ceef-1728-40d5-a71f-95a18dc7a532) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e91ceef-1728-40d5-a71f-95a18dc7a532) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd96f6-4faa-4fa7-b897-c28027998a73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume 87c82602-9bdc-4796-8147-c649046cd746: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-87c82602-9bdc-4796-8147-c649046cd746', 'volume_size': 1} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1982721463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=87c82602-9bdc-4796-8147-c649046cd746,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:53Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Creating volume 87c82602-9bdc-4796-8147-c649046cd746 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:53 devstack sudo[104041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 1073741824 Sep 03 12:06:53 devstack sudo[104041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (8e69b616-bad2-4ad7-b396-555caf49aef7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccfbbf0-7280-4c96-9c31-5d5a989b6f54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ccfbbf0-7280-4c96-9c31-5d5a989b6f54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877005579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00f6626-b51a-4626-ad5d-cd60e479d0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:54Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22731b58-d2af-462b-9b71-e57ee2c97247) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (22731b58-d2af-462b-9b71-e57ee2c97247) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cedd49-95a4-445b-8579-759889f7d3ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (57cedd49-95a4-445b-8579-759889f7d3ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e00f6626-b51a-4626-ad5d-cd60e479d0da', 'volume_name': 'volume-e00f6626-b51a-4626-ad5d-cd60e479d0da', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767ef0f6-5d7e-4895-96d6-f364b2f8ccd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (767ef0f6-5d7e-4895-96d6-f364b2f8ccd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f3a35e-77c6-453b-bece-9cbc9e310a50) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Volume e00f6626-b51a-4626-ad5d-cd60e479d0da: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e00f6626-b51a-4626-ad5d-cd60e479d0da', 'volume_size': 1} Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:53 devstack sudo[104041]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 1073741824" returned: 0 in 0.467s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:54 devstack sudo[104048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 Sep 03 12:06:54 devstack sudo[104048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:54 devstack sudo[104048]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.602s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-877005579',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e00f6626-b51a-4626-ad5d-cd60e479d0da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0fca825b72af410583fc16958c1af300',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:54Z,use_quota=True,user_id='c567ee4d970b4cbdbd9fdc350e88361a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Creating volume e00f6626-b51a-4626-ad5d-cd60e479d0da {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:54 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ebd96f6-4faa-4fa7-b897-c28027998a73) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-87c82602-9bdc-4796-8147-c649046cd746', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6914a5a8-80ba-4aa5-99e3-dbfdc05c17f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:54 devstack sudo[104051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da 1073741824 Sep 03 12:06:54 devstack sudo[104051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:54 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume volume-87c82602-9bdc-4796-8147-c649046cd746 (87c82602-9bdc-4796-8147-c649046cd746): created successfully Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6914a5a8-80ba-4aa5-99e3-dbfdc05c17f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (de8f1aa7-ac49-46eb-b255-3827090d554e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-adeb4130-fa0f-488b-afba-a95b1eb0381a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created volume successfully. Sep 03 12:06:54 devstack sudo[104051]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da 1073741824" returned: 0 in 0.474s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:54 devstack sudo[104058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da Sep 03 12:06:54 devstack sudo[104058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:55 devstack sudo[104058]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da" returned: 0 in 0.255s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] <== create_volume: return (765ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.769s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29f3a35e-77c6-453b-bece-9cbc9e310a50) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e00f6626-b51a-4626-ad5d-cd60e479d0da', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2040161-517e-498b-9c4c-ce64f8fb18b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:55 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Volume volume-e00f6626-b51a-4626-ad5d-cd60e479d0da (e00f6626-b51a-4626-ad5d-cd60e479d0da): created successfully Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2040161-517e-498b-9c4c-ce64f8fb18b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Flow 'volume_create_manager' (8e69b616-bad2-4ad7-b396-555caf49aef7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9fba5174-8971-4f81-aecc-71ebceab7a42 tempest-ProjectReaderTests-1304265993 None] Created volume successfully. Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-e00f6626-b51a-4626-ad5d-cd60e479d0da-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Lock "cinder-e00f6626-b51a-4626-ad5d-cd60e479d0da-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Acquiring lock "cinder-quobyte-e00f6626-b51a-4626-ad5d-cd60e479d0da" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-e00f6626-b51a-4626-ad5d-cd60e479d0da" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9869b659-d189-434d-93f9-5d44f3448a25]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:55 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (f18a3dfa-a9a5-4cbd-b8e1-a1dceaa48ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccf5d96-1d2a-4c7c-b3eb-96b7f56f4cb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7ccf5d96-1d2a-4c7c-b3eb-96b7f56f4cb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347167300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aa4675-9cfc-4fb5-8d81-6aba05bb3056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:56Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293757e5-6959-4291-a4cf-7776a809602a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (293757e5-6959-4291-a4cf-7776a809602a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea9a588-5340-41bd-b970-61f6de98ef0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ea9a588-5340-41bd-b970-61f6de98ef0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6aa4675-9cfc-4fb5-8d81-6aba05bb3056', 'volume_name': 'volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06aec4a5-25c5-4a80-89fd-4c672ae714ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06aec4a5-25c5-4a80-89fd-4c672ae714ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9587088-82a8-411c-a8c9-f7c89cc32d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume c6aa4675-9cfc-4fb5-8d81-6aba05bb3056: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056', 'volume_size': 1} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-347167300',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6aa4675-9cfc-4fb5-8d81-6aba05bb3056,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:56Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Creating volume c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:56 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:56 devstack sudo[104061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da Sep 03 12:06:56 devstack sudo[104061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:56 devstack sudo[104063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 1073741824 Sep 03 12:06:56 devstack sudo[104063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (8b12eac6-8e2a-4e51-85e4-5acc699bdff4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e007e73-4fb7-4b71-9f63-d884d6c10286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack sudo[104061]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e007e73-4fb7-4b71-9f63-d884d6c10286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139661121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ab7029-2e9b-49d9-9518-9f1732b3b61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:56Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60067755-0dda-4902-ad47-59557ca05513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60067755-0dda-4902-ad47-59557ca05513) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadf44a5-64a1-4c8b-997d-ab280aa02d6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cadf44a5-64a1-4c8b-997d-ab280aa02d6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0ab7029-2e9b-49d9-9518-9f1732b3b61f', 'volume_name': 'volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cec095-57f9-41b6-9fed-5187aa222c55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (53cec095-57f9-41b6-9fed-5187aa222c55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171e9df8-1a2d-4a3e-8cda-5074aaadcf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume e0ab7029-2e9b-49d9-9518-9f1732b3b61f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f', 'volume_size': 1} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da" returned: 0 in 0.538s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:56 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da Sep 03 12:06:56 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:56 devstack sudo[104063]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 1073741824" returned: 0 in 0.566s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:56 devstack sudo[104074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 Sep 03 12:06:56 devstack sudo[104074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:56 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (6395301a-e125-4ccc-a806-68a5ea0a0499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e832045b-1211-45a3-a787-af35235c46ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e00f6626-b51a-4626-ad5d-cd60e479d0da" returned: 0 in 0.363s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e832045b-1211-45a3-a787-af35235c46ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281953672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4945930a-ac3a-4069-80bb-351a6aac93c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:57Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5db7ba-d1d7-4a25-bfb9-e149beed9840) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5db7ba-d1d7-4a25-bfb9-e149beed9840) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd261f11-2566-415e-ad4a-3184141994fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd261f11-2566-415e-ad4a-3184141994fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4945930a-ac3a-4069-80bb-351a6aac93c2', 'volume_name': 'volume-4945930a-ac3a-4069-80bb-351a6aac93c2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac70a719-8b2e-4380-b2d7-e6fb2d2f9c19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ac70a719-8b2e-4380-b2d7-e6fb2d2f9c19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad6056c-1d33-42a5-8718-075cf6f66ba3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:56 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume 4945930a-ac3a-4069-80bb-351a6aac93c2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4945930a-ac3a-4069-80bb-351a6aac93c2', 'volume_size': 1} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Lock "cinder-quobyte-e00f6626-b51a-4626-ad5d-cd60e479d0da" released by "delete_volume" :: held 1.048s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Created reservations ['244485a8-58ea-4249-a2dd-c7dfab65b33c', 'abc7bee6-a83c-48a5-892e-7ab10e710bea', '826cbd5a-8819-4ea0-a6d6-f4063e6a02be', '8b1579a9-55a3-4db9-923d-6b7ad479f01a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:57 devstack sudo[104078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:06:57 devstack sudo[104078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:57 devstack sudo[104074]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056" returned: 0 in 0.487s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.731s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1139661121',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0ab7029-2e9b-49d9-9518-9f1732b3b61f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:56Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Creating volume e0ab7029-2e9b-49d9-9518-9f1732b3b61f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:57 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:57 devstack sudo[104080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f 1073741824 Sep 03 12:06:57 devstack sudo[104080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a9587088-82a8-411c-a8c9-f7c89cc32d54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a36447-5844-412f-8365-e9d7d5e46e1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (6b104e70-471a-4db0-8b16-034511a5cc81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f0cb0e-8711-4141-9185-fa931f645941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 (c6aa4675-9cfc-4fb5-8d81-6aba05bb3056): created successfully Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (58a36447-5844-412f-8365-e9d7d5e46e1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (f18a3dfa-a9a5-4cbd-b8e1-a1dceaa48ffa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (73f0cb0e-8711-4141-9185-fa931f645941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574736591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7cf5dd-3889-484c-a72b-d4b699c9609e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:57Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a158d0ae-4bbb-4aff-8b8a-e0e9d1e56019) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a158d0ae-4bbb-4aff-8b8a-e0e9d1e56019) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814fda39-1dea-4037-a45d-dfd99af35c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (814fda39-1dea-4037-a45d-dfd99af35c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee7cf5dd-3889-484c-a72b-d4b699c9609e', 'volume_name': 'volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655e01f0-151b-4bf0-98f0-9a77677f61c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (655e01f0-151b-4bf0-98f0-9a77677f61c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack sudo[104078]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a466ca7-2ad3-4ec8-ac98-eab351c9855f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume ee7cf5dd-3889-484c-a72b-d4b699c9609e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e', 'volume_size': 1} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-180c20fd-5cea-4c17-925c-5c07b9aa79da tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created volume successfully. Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.452s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:06:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Deleted volume successfully. Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b6066d4-38d1-40c0-a9e5-e7f48d523f6a tempest-ProjectReaderTests-1304265993 None] Lock "cinder-e00f6626-b51a-4626-ad5d-cd60e479d0da-delete_volume" released by "delete_volume" :: held 1.783s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:06:57 devstack sudo[104080]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (b7d15859-eadd-4c34-a7c3-b5b4c1237725) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0352de56-758d-4fce-b32e-4944f67af26f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f 1073741824" returned: 0 in 0.634s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0352de56-758d-4fce-b32e-4944f67af26f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620152748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71baed2-013d-4e6b-be88-9afb488af412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:58Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce4791b-ef33-4a66-be82-a7a469ac115b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce4791b-ef33-4a66-be82-a7a469ac115b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763129d8-1d7e-4224-89a9-d8adbf980382) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (763129d8-1d7e-4224-89a9-d8adbf980382) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b71baed2-013d-4e6b-be88-9afb488af412', 'volume_name': 'volume-b71baed2-013d-4e6b-be88-9afb488af412', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbda716-da88-4ee4-be28-044968d6ab00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfbda716-da88-4ee4-be28-044968d6ab00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3846e6df-666a-4297-b072-dae57f85bec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume b71baed2-013d-4e6b-be88-9afb488af412: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b71baed2-013d-4e6b-be88-9afb488af412', 'volume_size': 1} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:57 devstack sudo[104087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f Sep 03 12:06:57 devstack sudo[104087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:58 devstack sudo[104087]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] <== create_volume: return (996ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.277s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-281953672',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4945930a-ac3a-4069-80bb-351a6aac93c2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:57Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Creating volume 4945930a-ac3a-4069-80bb-351a6aac93c2 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:58 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (171e9df8-1a2d-4a3e-8cda-5074aaadcf92) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:58 devstack sudo[104090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 1073741824 Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dc9ced-9428-49b9-977d-10829dcba505) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:58 devstack sudo[104090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:58 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f (e0ab7029-2e9b-49d9-9518-9f1732b3b61f): created successfully Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96dc9ced-9428-49b9-977d-10829dcba505) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (8b12eac6-8e2a-4e51-85e4-5acc699bdff4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e55082e1-9f8f-4496-8f75-eedd3e4d035f tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created volume successfully. Sep 03 12:06:58 devstack sudo[104090]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 1073741824" returned: 0 in 0.543s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:58 devstack sudo[104097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 Sep 03 12:06:58 devstack sudo[104097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:59 devstack sudo[104097]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2" returned: 0 in 0.308s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] <== create_volume: return (905ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.909s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.569s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-574736591',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee7cf5dd-3889-484c-a72b-d4b699c9609e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:57Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Creating volume ee7cf5dd-3889-484c-a72b-d4b699c9609e {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:06:59 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad6056c-1d33-42a5-8718-075cf6f66ba3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4945930a-ac3a-4069-80bb-351a6aac93c2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:59 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e 1073741824 Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3382c3-4240-4b78-a345-36fbd573c445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:06:59 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:06:59 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume volume-4945930a-ac3a-4069-80bb-351a6aac93c2 (4945930a-ac3a-4069-80bb-351a6aac93c2): created successfully Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2e3382c3-4240-4b78-a345-36fbd573c445) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (6395301a-e125-4ccc-a806-68a5ea0a0499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:06:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-29671676-a167-4d96-9c1c-a4447b39674a tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created volume successfully. Sep 03 12:06:59 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e 1073741824" returned: 0 in 0.557s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:06:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:06:59 devstack sudo[104106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e Sep 03 12:06:59 devstack sudo[104106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:00 devstack sudo[104106]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] <== create_volume: return (896ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.902s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.134s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:06:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1620152748',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b71baed2-013d-4e6b-be88-9afb488af412,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='923fec1b95a841ea81dc0a736e57191c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:06:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:06:58Z,use_quota=True,user_id='bd6d9420ae9a45f3a979cca0454059ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Creating volume b71baed2-013d-4e6b-be88-9afb488af412 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:07:00 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a466ca7-2ad3-4ec8-ac98-eab351c9855f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0db6497-03c2-4d8b-84cf-581bdc17cfd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:00 devstack sudo[104109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 1073741824 Sep 03 12:07:00 devstack sudo[104109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e (ee7cf5dd-3889-484c-a72b-d4b699c9609e): created successfully Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b0db6497-03c2-4d8b-84cf-581bdc17cfd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (6b104e70-471a-4db0-8b16-034511a5cc81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:07:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-515311f2-4423-408a-a35c-639f304756ea tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created volume successfully. Sep 03 12:07:00 devstack sudo[104109]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 1073741824" returned: 0 in 0.563s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:00 devstack sudo[104115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 Sep 03 12:07:00 devstack sudo[104115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:00 devstack sudo[104115]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412" returned: 0 in 0.263s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] <== create_volume: return (873ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.876s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3846e6df-666a-4297-b072-dae57f85bec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b71baed2-013d-4e6b-be88-9afb488af412', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69faf91-e696-4e20-995c-01905ae081b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:00 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Volume volume-b71baed2-013d-4e6b-be88-9afb488af412 (b71baed2-013d-4e6b-be88-9afb488af412): created successfully Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d69faf91-e696-4e20-995c-01905ae081b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Flow 'volume_create_manager' (b7d15859-eadd-4c34-a7c3-b5b4c1237725) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:07:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3c5a96a4-8b1e-421c-a4a1-d790c7cc39e9 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created volume successfully. Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-b71baed2-013d-4e6b-be88-9afb488af412-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-b71baed2-013d-4e6b-be88-9afb488af412-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-quobyte-b71baed2-013d-4e6b-be88-9afb488af412" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-b71baed2-013d-4e6b-be88-9afb488af412" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc31e792-5b55-4495-b485-9057dade4aab]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:01 devstack sudo[104118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 Sep 03 12:07:01 devstack sudo[104118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:01 devstack sudo[104118]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412" returned: 0 in 0.387s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:01 devstack sudo[104125]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412 Sep 03 12:07:01 devstack sudo[104125]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:02 devstack sudo[104125]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b71baed2-013d-4e6b-be88-9afb488af412" returned: 0 in 0.262s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-b71baed2-013d-4e6b-be88-9afb488af412" released by "delete_volume" :: held 0.700s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created reservations ['0bba73bf-727d-47bd-81fe-cb0cc9f62f34', '32fd056e-ec2e-4b78-9e55-a75ff1eb50b4', '9c92f41c-b06f-4ed4-93bf-c25d254a8511', 'f59edc84-4eb7-448e-8144-2db52c85727d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:02 devstack sudo[104128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:07:02 devstack sudo[104128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:02 devstack sudo[104128]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.278s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:07:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Deleted volume successfully. Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1021714a-7304-4152-a5eb-36bac3fb8b2e tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-b71baed2-013d-4e6b-be88-9afb488af412-delete_volume" released by "delete_volume" :: held 1.244s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-ee7cf5dd-3889-484c-a72b-d4b699c9609e-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-ee7cf5dd-3889-484c-a72b-d4b699c9609e-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-quobyte-ee7cf5dd-3889-484c-a72b-d4b699c9609e" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-ee7cf5dd-3889-484c-a72b-d4b699c9609e" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[35dd60da-f8f6-4663-9e4e-792bb640e72f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:07:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:02 devstack sudo[104131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e Sep 03 12:07:02 devstack sudo[104131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:03 devstack sudo[104131]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e" returned: 0 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:03 devstack sudo[104136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e Sep 03 12:07:03 devstack sudo[104136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:03 devstack sudo[104136]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee7cf5dd-3889-484c-a72b-d4b699c9609e" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-ee7cf5dd-3889-484c-a72b-d4b699c9609e" released by "delete_volume" :: held 0.679s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created reservations ['0217cf9d-3db9-4e9c-9746-6fb08bec4993', 'd062708b-1488-4efc-88a0-4a08d32b6c74', '173d018a-be9c-4bdc-97c5-ff727294e547', '17169000-db74-4f4d-91fb-e0f6912b85d1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:03 devstack sudo[104139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:07:03 devstack sudo[104139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:03 devstack sudo[104139]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.264s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:07:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Deleted volume successfully. Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c4dca7fe-39e5-493e-a3ff-ddb5396e2288 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-ee7cf5dd-3889-484c-a72b-d4b699c9609e-delete_volume" released by "delete_volume" :: held 1.177s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-4945930a-ac3a-4069-80bb-351a6aac93c2-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-4945930a-ac3a-4069-80bb-351a6aac93c2-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-quobyte-4945930a-ac3a-4069-80bb-351a6aac93c2" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-4945930a-ac3a-4069-80bb-351a6aac93c2" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2122735-3c28-434c-9a55-0f7de37c049f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:07:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:03 devstack sudo[104143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 Sep 03 12:07:03 devstack sudo[104143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:04 devstack sudo[104143]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2" returned: 0 in 0.379s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:04 devstack sudo[104148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2 Sep 03 12:07:04 devstack sudo[104148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:04 devstack sudo[104148]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4945930a-ac3a-4069-80bb-351a6aac93c2" returned: 0 in 0.255s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-4945930a-ac3a-4069-80bb-351a6aac93c2" released by "delete_volume" :: held 0.681s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created reservations ['a4bfd7a5-82e6-4c5d-b00f-4583b85ad02a', '046144c0-22f9-4e6e-bcf1-c12197a8d2e3', '0ee66aea-1302-422d-979c-2ae6cd2f3f51', 'f2c40c0a-7419-4ba5-a19c-a1e7fc1f3c4c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:04 devstack sudo[104151]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:07:04 devstack sudo[104151]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:04 devstack sudo[104151]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:07:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Deleted volume successfully. Sep 03 12:07:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c0db587b-99c8-4de6-89b2-32514b277237 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-4945930a-ac3a-4069-80bb-351a6aac93c2-delete_volume" released by "delete_volume" :: held 1.205s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-e0ab7029-2e9b-49d9-9518-9f1732b3b61f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-e0ab7029-2e9b-49d9-9518-9f1732b3b61f-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-quobyte-e0ab7029-2e9b-49d9-9518-9f1732b3b61f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-e0ab7029-2e9b-49d9-9518-9f1732b3b61f" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecd50c85-c3fa-4c4d-818f-40233d6cb1e1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:05 devstack sudo[104154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f Sep 03 12:07:05 devstack sudo[104154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:05 devstack sudo[104154]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f" returned: 0 in 0.363s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:05 devstack sudo[104159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f Sep 03 12:07:05 devstack sudo[104159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:05 devstack sudo[104159]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-e0ab7029-2e9b-49d9-9518-9f1732b3b61f" returned: 0 in 0.241s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-e0ab7029-2e9b-49d9-9518-9f1732b3b61f" released by "delete_volume" :: held 0.655s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created reservations ['ae3243b7-5125-40a4-b7f9-be46a1c8e379', 'f3205c44-dc34-4d5f-95dc-de48f6c5dbc5', '56385178-a914-4495-9ba0-3628c637fcaa', '1fa8f12f-3400-456e-9108-afa6a8ec7d7d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:05 devstack sudo[104162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:07:05 devstack sudo[104162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:06 devstack sudo[104162]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:07:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Deleted volume successfully. Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0131fe80-a7df-485c-bdc9-a1ae8ce476a8 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-e0ab7029-2e9b-49d9-9518-9f1732b3b61f-delete_volume" released by "delete_volume" :: held 1.229s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-quobyte-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[03f92909-bb2e-40fe-8edf-3b68ab01e4b8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:06 devstack sudo[104165]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 Sep 03 12:07:06 devstack sudo[104165]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:06 devstack sudo[104165]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056" returned: 0 in 0.377s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:06 devstack sudo[104170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056 Sep 03 12:07:06 devstack sudo[104170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:07 devstack sudo[104170]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056" returned: 0 in 0.266s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056" released by "delete_volume" :: held 0.698s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created reservations ['823b32fa-a059-4146-b5e5-48c43ad7281e', '751b4da9-7b72-4484-a206-84574bfafbef', 'a4e48133-dbcf-4f45-bd1c-2865b4e7f183', '5926d72a-1ee1-45e1-9fca-aa8ef38949ad'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:07 devstack sudo[104173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:07:07 devstack sudo[104173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-87c82602-9bdc-4796-8147-c649046cd746-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:07 devstack sudo[104173]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.290s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:07:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Deleted volume successfully. Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-87c82602-9bdc-4796-8147-c649046cd746-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45b3632b-d2ba-4c9a-acfc-89274d4e4562 tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-c6aa4675-9cfc-4fb5-8d81-6aba05bb3056-delete_volume" released by "delete_volume" :: held 1.281s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "cinder-quobyte-87c82602-9bdc-4796-8147-c649046cd746" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-87c82602-9bdc-4796-8147-c649046cd746" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bcdb7dc-5297-4fe1-8190-ff27e41dd2dc]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:07:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:07 devstack sudo[104176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 Sep 03 12:07:07 devstack sudo[104176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:08 devstack sudo[104176]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:08 devstack sudo[104182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746 Sep 03 12:07:08 devstack sudo[104182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:08 devstack sudo[104182]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-87c82602-9bdc-4796-8147-c649046cd746" returned: 0 in 0.315s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-quobyte-87c82602-9bdc-4796-8147-c649046cd746" released by "delete_volume" :: held 0.763s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Created reservations ['8fc571a3-09c1-4936-838e-de6fba22bc5c', '3cff0c2f-4aba-4348-8fa3-d259fe0cf1a1', '601742a6-f1a9-4c74-bc19-13156cf761f1', 'a7b363b6-e04f-4d06-923b-a56ebb73b278'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:08 devstack sudo[104185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:07:08 devstack sudo[104185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:08 devstack sudo[104185]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.323s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:07:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Deleted volume successfully. Sep 03 12:07:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1d046a0f-708a-4088-9622-4ae0787567eb tempest-CreateVolumesFromSourceVolumeTest-1980585632 None] Lock "cinder-87c82602-9bdc-4796-8147-c649046cd746-delete_volume" released by "delete_volume" :: held 1.342s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:16 devstack sudo[104189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:07:16 devstack sudo[104189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:16 devstack sudo[104189]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.308s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 29 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:07:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:07:18 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=171,cinder:DELETE=15,cinder:SELECT=120,cinder:INSERT=39 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:07:18 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=68,cinder:INSERT=28,cinder:UPDATE=108,cinder:DELETE=7 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Flow 'volume_create_manager' (2dcbe199-8880-42ba-b4b1-83ddd58ed541) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04de36b-f10f-4e40-a76a-bd6866348e0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f04de36b-f10f-4e40-a76a-bd6866348e0c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-472097726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b08800-267a-4e54-bfa1-810bea60b201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67eb6e2b8b74de5b76f1ef0ca6faa73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:07:23Z,use_quota=True,user_id='a29fcbb0c5e549a6a26ab1847c6c908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50599dcf-00b1-415f-b7db-6525998804cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (50599dcf-00b1-415f-b7db-6525998804cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4adea3-e157-4d41-b8af-b59ef4cbc8d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a4adea3-e157-4d41-b8af-b59ef4cbc8d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a3b08800-267a-4e54-bfa1-810bea60b201', 'volume_name': 'volume-a3b08800-267a-4e54-bfa1-810bea60b201', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cc231d-9f66-4284-addf-cc149959fccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e7cc231d-9f66-4284-addf-cc149959fccc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e136d6-4ce0-41b7-bb30-5db6caa1ce54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:22 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Volume a3b08800-267a-4e54-bfa1-810bea60b201: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a3b08800-267a-4e54-bfa1-810bea60b201', 'volume_size': 1} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-472097726',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a3b08800-267a-4e54-bfa1-810bea60b201,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67eb6e2b8b74de5b76f1ef0ca6faa73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:07:23Z,use_quota=True,user_id='a29fcbb0c5e549a6a26ab1847c6c908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Creating volume a3b08800-267a-4e54-bfa1-810bea60b201 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:07:22 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:07:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:22 devstack sudo[104195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 1073741824 Sep 03 12:07:22 devstack sudo[104195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Flow 'volume_create_manager' (1a34ef78-817b-4a2e-9a0a-331bc797ba9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ffb9c4-dfe1-4927-9b7c-5b284706b317) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (61ffb9c4-dfe1-4927-9b7c-5b284706b317) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1052141213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1e5544-2752-42eb-9541-42384d619f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67eb6e2b8b74de5b76f1ef0ca6faa73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:07:23Z,use_quota=True,user_id='a29fcbb0c5e549a6a26ab1847c6c908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d80b0-12d6-42f4-a4ad-69b8911785c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d77d80b0-12d6-42f4-a4ad-69b8911785c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6473b13a-98ac-4d34-af25-deb8a982a614) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6473b13a-98ac-4d34-af25-deb8a982a614) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be1e5544-2752-42eb-9541-42384d619f91', 'volume_name': 'volume-be1e5544-2752-42eb-9541-42384d619f91', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a445568-1cdc-4e3a-8db7-d2537f90fec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a445568-1cdc-4e3a-8db7-d2537f90fec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d97c5f-602f-4728-a442-ddbcba51e08b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Volume be1e5544-2752-42eb-9541-42384d619f91: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be1e5544-2752-42eb-9541-42384d619f91', 'volume_size': 1} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:23 devstack sudo[104195]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 1073741824" returned: 0 in 0.507s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:23 devstack sudo[104202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 Sep 03 12:07:23 devstack sudo[104202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:23 devstack sudo[104202]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201" returned: 0 in 0.256s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] <== create_volume: return (805ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.809s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.466s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:07:23Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1052141213',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be1e5544-2752-42eb-9541-42384d619f91,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c67eb6e2b8b74de5b76f1ef0ca6faa73',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:07:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:07:23Z,use_quota=True,user_id='a29fcbb0c5e549a6a26ab1847c6c908b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Creating volume be1e5544-2752-42eb-9541-42384d619f91 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:07:23 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:23 devstack sudo[104205]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 1073741824 Sep 03 12:07:23 devstack sudo[104205]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6e136d6-4ce0-41b7-bb30-5db6caa1ce54) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a3b08800-267a-4e54-bfa1-810bea60b201', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd28b6a3-179d-4adf-be14-63e06e8bd6d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Volume volume-a3b08800-267a-4e54-bfa1-810bea60b201 (a3b08800-267a-4e54-bfa1-810bea60b201): created successfully Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd28b6a3-179d-4adf-be14-63e06e8bd6d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Flow 'volume_create_manager' (2dcbe199-8880-42ba-b4b1-83ddd58ed541) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:07:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-af412970-c134-4c25-b408-ae4e2ec618cb tempest-TestServerVolumeAttachmentScenario-1108363166 None] Created volume successfully. Sep 03 12:07:24 devstack sudo[104205]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 1073741824" returned: 0 in 0.492s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:07:24 devstack sudo[104212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 Sep 03 12:07:24 devstack sudo[104212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:07:24 devstack sudo[104212]: pam_unix(sudo:session): session closed for user root Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] <== create_volume: return (784ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.788s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16d97c5f-602f-4728-a442-ddbcba51e08b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be1e5544-2752-42eb-9541-42384d619f91', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c07c09-9f09-4fd6-8184-50410a8cb351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:07:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Volume volume-be1e5544-2752-42eb-9541-42384d619f91 (be1e5544-2752-42eb-9541-42384d619f91): created successfully Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c3c07c09-9f09-4fd6-8184-50410a8cb351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:07:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Flow 'volume_create_manager' (1a34ef78-817b-4a2e-9a0a-331bc797ba9d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:07:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ad7972fd-5012-455a-82b8-c69ecd079390 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Created volume successfully. Sep 03 12:07:34 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=1,cinder:INSERT=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:07:34 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=3,cinder:UPDATE=5,cinder:INSERT=1,cinder:DELETE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:07:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-c713d519-d20d-4a85-81f9-56606a2d90f2 req-0a406ad2-7901-4ee1-8ed0-4937b818aa5e tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-c713d519-d20d-4a85-81f9-56606a2d90f2 req-0a406ad2-7901-4ee1-8ed0-4937b818aa5e tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-c713d519-d20d-4a85-81f9-56606a2d90f2 req-0a406ad2-7901-4ee1-8ed0-4937b818aa5e tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-c713d519-d20d-4a85-81f9-56606a2d90f2 req-0a406ad2-7901-4ee1-8ed0-4937b818aa5e tempest-TestServerVolumeAttachmentScenario-1108363166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-a3b08800-267a-4e54-bfa1-810bea60b201', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26907609-3da2-4c8e-a88f-588e9c8f2a9f', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:07:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-c713d519-d20d-4a85-81f9-56606a2d90f2 req-0a406ad2-7901-4ee1-8ed0-4937b818aa5e tempest-TestServerVolumeAttachmentScenario-1108363166 None] attachment_update completed successfully. Sep 03 12:07:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-19a0096a-711d-4efc-856c-846a3bf652dd req-bc9863d7-deb1-4957-8518-eba7895f8153 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:07:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-19a0096a-711d-4efc-856c-846a3bf652dd req-bc9863d7-deb1-4957-8518-eba7895f8153 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:07:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [req-19a0096a-711d-4efc-856c-846a3bf652dd req-bc9863d7-deb1-4957-8518-eba7895f8153 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:07:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-19a0096a-711d-4efc-856c-846a3bf652dd req-bc9863d7-deb1-4957-8518-eba7895f8153 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885', 'name': 'volume-be1e5544-2752-42eb-9541-42384d619f91', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3c50e715-05f0-46bc-9fa5-b94be64d6d3e', 'enforce_multipath': True} {{(pid=87256) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Sep 03 12:07:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-19a0096a-711d-4efc-856c-846a3bf652dd req-bc9863d7-deb1-4957-8518-eba7895f8153 tempest-TestServerVolumeAttachmentScenario-1108363166 None] attachment_update completed successfully. Sep 03 12:07:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-da0577dc-c129-401c-89af-92c39e82a64c req-47ec328a-1c18-4044-9105-925982d8350f tempest-TestServerVolumeAttachmentScenario-1108363166 None] Terminate volume connection completed successfully. Sep 03 12:07:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-da0577dc-c129-401c-89af-92c39e82a64c req-47ec328a-1c18-4044-9105-925982d8350f tempest-TestServerVolumeAttachmentScenario-1108363166 None] Deleting attachment 3c50e715-05f0-46bc-9fa5-b94be64d6d3e. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:08:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [req-b08ca400-2513-41bf-b564-fa180fec8914 req-3ff0b247-c7dc-46ff-8d80-dafd50ba7733 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Terminate volume connection completed successfully. Sep 03 12:08:00 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [req-b08ca400-2513-41bf-b564-fa180fec8914 req-3ff0b247-c7dc-46ff-8d80-dafd50ba7733 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Deleting attachment 26907609-3da2-4c8e-a88f-588e9c8f2a9f. {{(pid=87256) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Sep 03 12:08:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "cinder-be1e5544-2752-42eb-9541-42384d619f91-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-be1e5544-2752-42eb-9541-42384d619f91-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "cinder-quobyte-be1e5544-2752-42eb-9541-42384d619f91" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-quobyte-be1e5544-2752-42eb-9541-42384d619f91" acquired by "delete_volume" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[874b4352-5631-4633-8cde-114fdd1a6cf3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:05 devstack sudo[104841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 Sep 03 12:08:05 devstack sudo[104841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:05 devstack sudo[104841]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:05 devstack sudo[104846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91 Sep 03 12:08:05 devstack sudo[104846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:05 devstack sudo[104846]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-be1e5544-2752-42eb-9541-42384d619f91" returned: 0 in 0.234s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-quobyte-be1e5544-2752-42eb-9541-42384d619f91" released by "delete_volume" :: held 0.620s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Created reservations ['536d7d97-ac23-4d7d-9cc1-998086fef822', '43d5e3ff-519e-4458-8f22-80e4892ea009', '0bdd60ad-936f-4b6f-9c09-a3fc035a9922', 'a14e6357-f2d4-4448-ba1a-5f58b38ab292'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:05 devstack sudo[104849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:08:05 devstack sudo[104849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:05 devstack sudo[104849]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.241s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:08:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Deleted volume successfully. Sep 03 12:08:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6a7cbac7-eb6c-4377-97a4-b554d9c9d738 tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-be1e5544-2752-42eb-9541-42384d619f91-delete_volume" released by "delete_volume" :: held 1.045s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "cinder-a3b08800-267a-4e54-bfa1-810bea60b201-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-a3b08800-267a-4e54-bfa1-810bea60b201-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "cinder-quobyte-a3b08800-267a-4e54-bfa1-810bea60b201" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-quobyte-a3b08800-267a-4e54-bfa1-810bea60b201" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5601150a-d641-473d-90bd-12917cda1439]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:06 devstack sudo[104852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 Sep 03 12:08:06 devstack sudo[104852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:06 devstack sudo[104852]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201" returned: 0 in 0.346s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:06 devstack sudo[104857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201 Sep 03 12:08:06 devstack sudo[104857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:06 devstack sudo[104857]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a3b08800-267a-4e54-bfa1-810bea60b201" returned: 0 in 0.234s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-quobyte-a3b08800-267a-4e54-bfa1-810bea60b201" released by "delete_volume" :: held 0.614s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Created reservations ['d1a27917-6049-4beb-8dc9-889109c108f4', 'b2891537-cc90-4044-8cfd-6fc3659a7a3f', '8a8de1be-4713-45f1-87e8-7b363b3d51e4', '6fe46e15-955f-4b63-878d-085461562301'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:06 devstack sudo[104860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:08:06 devstack sudo[104860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:07 devstack sudo[104860]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:07 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:08:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Deleted volume successfully. Sep 03 12:08:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-59f1c085-a419-4eae-9a22-3b4cdc953b4d tempest-TestServerVolumeAttachmentScenario-1108363166 None] Lock "cinder-a3b08800-267a-4e54-bfa1-810bea60b201-delete_volume" released by "delete_volume" :: held 1.048s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:16 devstack sudo[104868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:08:16 devstack sudo[104868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:16 devstack sudo[104868]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 29 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:08:16 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=22,cinder:UPDATE=22,cinder:INSERT=6,cinder:DELETE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:08:17 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=28,cinder:UPDATE=16,cinder:INSERT=2,cinder:DELETE=1 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Flow 'volume_create_manager' (dba4a98a-1221-4cff-a34f-096b311070ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae79f821-ab2f-4f9e-aa13-489a36bb70bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae79f821-ab2f-4f9e-aa13-489a36bb70bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d187ac3-0919-4bf9-8021-945115606580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3045bb9420b4b51b222e998e0409a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:08:21Z,use_quota=True,user_id='6952fff7349141d3aea505ab2ae65e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cb5c637-f938-4268-8ba4-ba3dcba362bd),volume_type_id=0cb5c637-f938-4268-8ba4-ba3dcba362bd)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a354e46-e592-47d4-bc8c-b21ccf957691) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a354e46-e592-47d4-bc8c-b21ccf957691) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c91fdd-29c7-473d-9174-ac16a24753f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:20 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (99c91fdd-29c7-473d-9174-ac16a24753f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '0d187ac3-0919-4bf9-8021-945115606580', 'volume_name': 'volume-0d187ac3-0919-4bf9-8021-945115606580', 'volume_size': 1, 'image_id': 'f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '493688e78bd9b6fd2a0583f0801dfb2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f3045bb9420b4b51b222e998e0409a87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55326c32e0eaa1b4209836d961daba14c294a0dfa43df51dd08138d9a2159a229ecaf45cf99fc6d368efcd1838065f0b09c2116ee2ffaa76a480868d6d2c6abd', 'id': 'f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'created_at': datetime.datetime(2026, 9, 3, 10, 8, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 8, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a41345-634f-421d-98c7-dfdc4682fad3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a41345-634f-421d-98c7-dfdc4682fad3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb0a912-9e0f-433e-bb64-a070e55b5246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:21 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Volume 0d187ac3-0919-4bf9-8021-945115606580: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-0d187ac3-0919-4bf9-8021-945115606580', 'volume_size': 1, 'image_id': 'f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '493688e78bd9b6fd2a0583f0801dfb2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f3045bb9420b4b51b222e998e0409a87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55326c32e0eaa1b4209836d961daba14c294a0dfa43df51dd08138d9a2159a229ecaf45cf99fc6d368efcd1838065f0b09c2116ee2ffaa76a480868d6d2c6abd', 'id': 'f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'created_at': datetime.datetime(2026, 9, 3, 10, 8, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 8, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Trying to clone 0d187ac3-0919-4bf9-8021-945115606580 from image f20f40dd-bac8-4513-a2a2-c5f1abe05b71 at location (None, [{'url': 'file:///opt/stack/data/glance/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:08:21 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Image download 0.00 MB at 0.00 MB/s Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b3595d0-cd76-4f3c-b446-19dfc47e57f1]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:21 devstack sudo[104872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD Sep 03 12:08:21 devstack sudo[104872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:21 devstack sudo[104872]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD" returned: 0 in 0.326s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:21 devstack sudo[104876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD Sep 03 12:08:21 devstack sudo[104876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:21 devstack sudo[104876]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD" returned: 1 in 0.318s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Temporary image f20f40dd-bac8-4513-a2a2-c5f1abe05b71 is fetched for user 6952fff7349141d3aea505ab2ae65e42. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3cb03b8-72d0-4f9c-b22b-3ec73df0614e]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:22 devstack sudo[104881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD Sep 03 12:08:22 devstack sudo[104881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:22 devstack sudo[104881]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD" returned: 0 in 0.323s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:22 devstack sudo[104885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD Sep 03 12:08:22 devstack sudo[104885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:22 devstack sudo[104885]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD" returned: 1 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:08:21Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d187ac3-0919-4bf9-8021-945115606580,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f3045bb9420b4b51b222e998e0409a87',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:08:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:08:21Z,use_quota=True,user_id='6952fff7349141d3aea505ab2ae65e42',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0cb5c637-f938-4268-8ba4-ba3dcba362bd),volume_type_id=0cb5c637-f938-4268-8ba4-ba3dcba362bd)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Creating volume 0d187ac3-0919-4bf9-8021-945115606580 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:08:22 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:22 devstack sudo[104890]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 1073741824 Sep 03 12:08:22 devstack sudo[104890]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:22 devstack sudo[104890]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 1073741824" returned: 0 in 0.397s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:23 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 Sep 03 12:08:23 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:23 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580" returned: 0 in 0.237s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] <== create_volume: return (673ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Attempting download of f20f40dd-bac8-4513-a2a2-c5f1abe05b71 ((None, [{'url': 'file:///opt/stack/data/glance/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'metadata': {}}])) to volume 0d187ac3-0919-4bf9-8021-945115606580. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[15d8012c-5b0d-491b-a787-0b8bc689636b]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_g4s_5b6h {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:23 devstack sudo[104901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_g4s_5b6h Sep 03 12:08:23 devstack sudo[104901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:23 devstack sudo[104901]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_g4s_5b6h" returned: 0 in 0.313s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_g4s_5b6h {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:23 devstack sudo[104905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_g4s_5b6h Sep 03 12:08:23 devstack sudo[104905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:23 devstack sudo[104905]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_g4s_5b6h" returned: 1 in 0.313s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_g4s_5b6h' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[44773a4a-0e84-4d1c-acf0-06b6fbec4191]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:24 devstack sudo[104910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD Sep 03 12:08:24 devstack sudo[104910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:24 devstack sudo[104910]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD" returned: 0 in 0.310s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:24 devstack sudo[104914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD Sep 03 12:08:24 devstack sudo[104914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:24 devstack sudo[104914]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD" returned: 1 in 0.311s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] f20f40dd-bac8-4513-a2a2-c5f1abe05b71 was raw, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:24 devstack sudo[104919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 Sep 03 12:08:24 devstack sudo[104919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:24 devstack sudo[104919]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580" returned: 0 in 0.416s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f20f40dd-bac8-4513-a2a2-c5f1abe05b71_dcp1wwcpdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:08:24 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 12:08:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:25 devstack sudo[104925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 1G Sep 03 12:08:25 devstack sudo[104925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:25 devstack sudo[104925]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 1G" returned: 0 in 0.300s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Downloaded image f20f40dd-bac8-4513-a2a2-c5f1abe05b71 ((None, [{'url': 'file:///opt/stack/data/glance/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'metadata': {}}])) to volume 0d187ac3-0919-4bf9-8021-945115606580 successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Temporary image f20f40dd-bac8-4513-a2a2-c5f1abe05b71 for user 6952fff7349141d3aea505ab2ae65e42 is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Marking volume 0d187ac3-0919-4bf9-8021-945115606580 as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Copying metadata from image f20f40dd-bac8-4513-a2a2-c5f1abe05b71 to 0d187ac3-0919-4bf9-8021-945115606580. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Creating volume glance metadata for volume 0d187ac3-0919-4bf9-8021-945115606580 backed by image f20f40dd-bac8-4513-a2a2-c5f1abe05b71 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '493688e78bd9b6fd2a0583f0801dfb2a', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6cb0a912-9e0f-433e-bb64-a070e55b5246) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d187ac3-0919-4bf9-8021-945115606580', 'volume_size': 1, 'image_id': 'f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '493688e78bd9b6fd2a0583f0801dfb2a', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'f3045bb9420b4b51b222e998e0409a87', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '55326c32e0eaa1b4209836d961daba14c294a0dfa43df51dd08138d9a2159a229ecaf45cf99fc6d368efcd1838065f0b09c2116ee2ffaa76a480868d6d2c6abd', 'id': 'f20f40dd-bac8-4513-a2a2-c5f1abe05b71', 'created_at': datetime.datetime(2026, 9, 3, 10, 8, 19, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 8, 20, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f20f40dd-bac8-4513-a2a2-c5f1abe05b71/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b53a43e-bb93-4200-b566-80dd1a92f766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Volume volume-0d187ac3-0919-4bf9-8021-945115606580 (0d187ac3-0919-4bf9-8021-945115606580): created successfully Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5b53a43e-bb93-4200-b566-80dd1a92f766) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Flow 'volume_create_manager' (dba4a98a-1221-4cff-a34f-096b311070ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:08:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5d7768d8-8519-45fe-8472-2386fc382ebb tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Created volume successfully. Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Acquiring lock "cinder-0d187ac3-0919-4bf9-8021-945115606580-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "cinder-0d187ac3-0919-4bf9-8021-945115606580-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Acquiring lock "cinder-quobyte-0d187ac3-0919-4bf9-8021-945115606580" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "cinder-quobyte-0d187ac3-0919-4bf9-8021-945115606580" acquired by "delete_volume" :: waited 0.012s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[18dee88b-a509-49f6-9159-0a185cc3c73e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:26 devstack sudo[104930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 Sep 03 12:08:26 devstack sudo[104930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:26 devstack sudo[104930]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580" returned: 0 in 0.364s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:26 devstack sudo[104935]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580 Sep 03 12:08:26 devstack sudo[104935]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:27 devstack sudo[104935]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0d187ac3-0919-4bf9-8021-945115606580" returned: 0 in 0.265s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "cinder-quobyte-0d187ac3-0919-4bf9-8021-945115606580" released by "delete_volume" :: held 0.666s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:27 devstack cinder-volume[87256]: WARNING cinder.quota [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:08:27 devstack cinder-volume[87256]: WARNING cinder.quota [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Created reservations ['ac019f54-908b-4fa6-95f7-94b59fcf2043', 'af0c9a85-b749-458e-8929-060eec90eb6b', '8ca2a5e1-4291-45e2-8be7-30bc316bfca9', '5ce8f05c-5174-4075-ab66-615353ea173e'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:27 devstack sudo[104938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:08:27 devstack sudo[104938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:27 devstack sudo[104938]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.244s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:08:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Deleted volume successfully. Sep 03 12:08:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-220f8e1a-b5f0-4929-b0a2-b68c4fbdbaca tempest-VolumeAndVolumeTypeFromImageTest-974569256 None] Lock "cinder-0d187ac3-0919-4bf9-8021-945115606580-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Flow 'volume_create_manager' (888c6d4e-ecaf-44e6-a079-f2562cb0dfee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0f7f84-8928-4e54-9e23-b07746b3f851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d0f7f84-8928-4e54-9e23-b07746b3f851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1944639871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aead306d-c826-42dd-9031-a93b38cacfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00c534fd01c4944ac548ec80a3e18a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:08:32Z,use_quota=True,user_id='0b872c6bdde547308de507abcf24ac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391883c9-1ece-4599-b4da-1e09ae4dd1b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (391883c9-1ece-4599-b4da-1e09ae4dd1b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2a7a33-d9fc-401e-a2fe-83604e5ea64b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a2a7a33-d9fc-401e-a2fe-83604e5ea64b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'aead306d-c826-42dd-9031-a93b38cacfd8', 'volume_name': 'volume-aead306d-c826-42dd-9031-a93b38cacfd8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f59b73a-c100-4210-b61b-e82765fc37ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f59b73a-c100-4210-b61b-e82765fc37ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241bec78-227f-4915-8996-565aa81d9d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:31 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Volume aead306d-c826-42dd-9031-a93b38cacfd8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-aead306d-c826-42dd-9031-a93b38cacfd8', 'volume_size': 1} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:08:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1944639871',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aead306d-c826-42dd-9031-a93b38cacfd8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00c534fd01c4944ac548ec80a3e18a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:08:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:08:32Z,use_quota=True,user_id='0b872c6bdde547308de507abcf24ac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Creating volume aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:08:31 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:08:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:31 devstack sudo[104978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 1073741824 Sep 03 12:08:31 devstack sudo[104978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:32 devstack sudo[104978]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 1073741824" returned: 0 in 0.389s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:32 devstack sudo[104983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 Sep 03 12:08:32 devstack sudo[104983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:32 devstack sudo[104983]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8" returned: 0 in 0.242s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] <== create_volume: return (671ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.674s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (241bec78-227f-4915-8996-565aa81d9d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aead306d-c826-42dd-9031-a93b38cacfd8', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3412318a-e7e3-4339-9e2b-90011e5039c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:32 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Volume volume-aead306d-c826-42dd-9031-a93b38cacfd8 (aead306d-c826-42dd-9031-a93b38cacfd8): created successfully Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3412318a-e7e3-4339-9e2b-90011e5039c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Flow 'volume_create_manager' (888c6d4e-ecaf-44e6-a079-f2562cb0dfee) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:08:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-08c16a0b-4cff-489e-9551-7a257b3f5c10 tempest-VolumeDependencyTests-485182322 None] Created volume successfully. Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Creating offline snapshot 4890bbe9-8fc9-427e-a77c-2090d9c32154 of volume aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a2ea56ae-0b6b-4968-a05a-8ae72dc293f7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:32 devstack sudo[104986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 Sep 03 12:08:32 devstack sudo[104986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:33 devstack sudo[104986]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8" returned: 0 in 0.349s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:33 devstack sudo[104991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 1G Sep 03 12:08:33 devstack sudo[104991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:33 devstack sudo[104991]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 1G" returned: 0 in 0.369s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aead306d-c826-42dd-9031-a93b38cacfd8 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:33 devstack sudo[104996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aead306d-c826-42dd-9031-a93b38cacfd8 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 Sep 03 12:08:33 devstack sudo[104996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:33 devstack sudo[104996]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-aead306d-c826-42dd-9031-a93b38cacfd8 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154" returned: 0 in 0.272s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:33 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 is being set with open permissions: ugo+rw Sep 03 12:08:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:33 devstack sudo[105002]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 Sep 03 12:08:33 devstack sudo[105002]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:34 devstack sudo[105002]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154" returned: 0 in 0.229s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:34 devstack sudo[105006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.info Sep 03 12:08:34 devstack sudo[105006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:34 devstack sudo[105006]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.info" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:34 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.info is being set with open permissions: ugo+rw Sep 03 12:08:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:34 devstack sudo[105009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.info Sep 03 12:08:34 devstack sudo[105009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:34 devstack sudo[105009]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.info" returned: 0 in 0.232s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.784s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-56590811-c5c6-4985-a969-6abdc8e2938a tempest-VolumeDependencyTests-485182322 None] Create snapshot completed successfully Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Flow 'volume_create_manager' (47d530c2-7448-4fd9-b20b-d023a4643e99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14958112-2dde-4186-842f-5d3eb7e89fef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (14958112-2dde-4186-842f-5d3eb7e89fef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:08:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1962232216',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=20de94d6-83ff-4a82-974e-9e086d6794bc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f00c534fd01c4944ac548ec80a3e18a6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:08:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4890bbe9-8fc9-427e-a77c-2090d9c32154,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:08:35Z,use_quota=True,user_id='0b872c6bdde547308de507abcf24ac02',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a02e1d-0e52-49c5-86ab-5fddda957d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2a02e1d-0e52-49c5-86ab-5fddda957d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef92b47-7b64-4fbc-8a52-2ac6ec465be0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fef92b47-7b64-4fbc-8a52-2ac6ec465be0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '20de94d6-83ff-4a82-974e-9e086d6794bc', 'volume_name': 'volume-20de94d6-83ff-4a82-974e-9e086d6794bc', 'volume_size': 1, 'snapshot_id': '4890bbe9-8fc9-427e-a77c-2090d9c32154'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff772e4-be77-414a-93e3-e844fe98031e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bff772e4-be77-414a-93e3-e844fe98031e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de002871-2d14-46dd-aea2-5d773c8fa11b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:35 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Volume 20de94d6-83ff-4a82-974e-9e086d6794bc: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-20de94d6-83ff-4a82-974e-9e086d6794bc', 'volume_size': 1, 'snapshot_id': '4890bbe9-8fc9-427e-a77c-2090d9c32154'} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-quobyte-4890bbe9-8fc9-427e-a77c-2090d9c32154-20de94d6-83ff-4a82-974e-9e086d6794bc" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-4890bbe9-8fc9-427e-a77c-2090d9c32154-20de94d6-83ff-4a82-974e-9e086d6794bc" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Creating volume 20de94d6-83ff-4a82-974e-9e086d6794bc from snapshot 4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-quobyte-20de94d6-83ff-4a82-974e-9e086d6794bc" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-20de94d6-83ff-4a82-974e-9e086d6794bc" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] snapshot: 4890bbe9-8fc9-427e-a77c-2090d9c32154, volume: 20de94d6-83ff-4a82-974e-9e086d6794bc, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[07a74366-b4c0-4b32-8660-0934204cdb70]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:35 devstack sudo[105012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 Sep 03 12:08:35 devstack sudo[105012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:35 devstack sudo[105012]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154" returned: 0 in 0.343s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aead306d-c826-42dd-9031-a93b38cacfd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff7636b4-d0d4-4c5c-b16a-56cca31b072e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:35 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 Sep 03 12:08:35 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:36 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8" returned: 0 in 0.342s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:08:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:08:36 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:08:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:36 devstack sudo[105022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc Sep 03 12:08:36 devstack sudo[105022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:40 devstack sudo[105022]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc" returned: 0 in 4.064s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8, size 1024.00 MB, duration 4.07 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:08:40 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Converted 1024.00 MB image at 251.89 MB/s Sep 03 12:08:40 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc is being set with open permissions: ugo+rw Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:40 devstack sudo[105035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc Sep 03 12:08:40 devstack sudo[105035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:40 devstack sudo[105035]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc" returned: 0 in 0.232s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-20de94d6-83ff-4a82-974e-9e086d6794bc" released by "_copy_volume_from_snapshot" :: held 5.049s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-4890bbe9-8fc9-427e-a77c-2090d9c32154-20de94d6-83ff-4a82-974e-9e086d6794bc" released by "_create_volume_from_snapshot" :: held 5.103s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.119s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (de002871-2d14-46dd-aea2-5d773c8fa11b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-20de94d6-83ff-4a82-974e-9e086d6794bc', 'volume_size': 1, 'snapshot_id': '4890bbe9-8fc9-427e-a77c-2090d9c32154'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c385ee1d-1b88-4ed2-964d-46ee40d24efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:08:40 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Volume volume-20de94d6-83ff-4a82-974e-9e086d6794bc (20de94d6-83ff-4a82-974e-9e086d6794bc): created successfully Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c385ee1d-1b88-4ed2-964d-46ee40d24efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Flow 'volume_create_manager' (47d530c2-7448-4fd9-b20b-d023a4643e99) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:08:40 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-88f83e33-3c51-4e88-8881-5a419d859824 tempest-VolumeDependencyTests-485182322 None] Created volume successfully. Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-4890bbe9-8fc9-427e-a77c-2090d9c32154-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-4890bbe9-8fc9-427e-a77c-2090d9c32154-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-quobyte-aead306d-c826-42dd-9031-a93b38cacfd8" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-aead306d-c826-42dd-9031-a93b38cacfd8" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-quobyte-4890bbe9-8fc9-427e-a77c-2090d9c32154" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-4890bbe9-8fc9-427e-a77c-2090d9c32154" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Deleting offline snapshot 4890bbe9-8fc9-427e-a77c-2090d9c32154 of volume aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] snapshot_file for this snap is: volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[39302056-88fa-4b8e-a637-ad3e0ad6c10f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:40 devstack sudo[105041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 Sep 03 12:08:40 devstack sudo[105041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:41 devstack sudo[105041]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154" returned: 0 in 0.358s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-aead306d-c826-42dd-9031-a93b38cacfd8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:08:41 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5706987f-4c5c-47b9-9b3a-702b1d410000]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:41 devstack sudo[105049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 Sep 03 12:08:41 devstack sudo[105049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:41 devstack sudo[105049]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8" returned: 0 in 0.522s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:41 devstack sudo[105054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 Sep 03 12:08:41 devstack sudo[105054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:42 devstack sudo[105054]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154" returned: 0 in 0.330s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:42 devstack sudo[105059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154 Sep 03 12:08:42 devstack sudo[105059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:42 devstack sudo[105059]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8.4890bbe9-8fc9-427e-a77c-2090d9c32154" returned: 0 in 0.246s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-4890bbe9-8fc9-427e-a77c-2090d9c32154" released by "_delete_snapshot" :: held 1.543s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-aead306d-c826-42dd-9031-a93b38cacfd8" released by "delete_snapshot" :: held 1.563s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Created reservations ['d424b8b5-172b-4bfa-a535-d0259b772f95', '3200321b-6697-4927-980c-a3f18260ac07', '471c6d7a-c170-440f-8a77-8af6959f8b04', '570c8a29-1527-4091-904d-b2e27d3feffa'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:08:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Delete snapshot completed successfully. Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-15d9574d-f8e7-4f41-b792-6c7d5046eb72 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-4890bbe9-8fc9-427e-a77c-2090d9c32154-delete_snapshot" released by "delete_snapshot" :: held 1.691s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-aead306d-c826-42dd-9031-a93b38cacfd8-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-aead306d-c826-42dd-9031-a93b38cacfd8-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-quobyte-aead306d-c826-42dd-9031-a93b38cacfd8" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-aead306d-c826-42dd-9031-a93b38cacfd8" acquired by "delete_volume" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2070bb6f-302f-48a2-bd55-9e6d22c476c7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:43 devstack sudo[105064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 Sep 03 12:08:43 devstack sudo[105064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:43 devstack sudo[105064]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8" returned: 0 in 0.346s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:43 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8 Sep 03 12:08:43 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:43 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-aead306d-c826-42dd-9031-a93b38cacfd8" returned: 0 in 0.241s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-aead306d-c826-42dd-9031-a93b38cacfd8" released by "delete_volume" :: held 0.639s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Created reservations ['bde8f9e4-eed4-44e2-948f-eebda62c6d9b', '85de4d7d-8707-4176-afcd-72a20fc41250', 'b0f22633-629d-4c44-81c2-1e92cc053126', '80197d3f-5805-4f06-a388-533ab916d1f3'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:43 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:08:43 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:44 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.246s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:08:44 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Deleted volume successfully. Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f1a9391d-d89b-4750-b669-73285ce5cd79 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-aead306d-c826-42dd-9031-a93b38cacfd8-delete_volume" released by "delete_volume" :: held 1.067s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-20de94d6-83ff-4a82-974e-9e086d6794bc-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-20de94d6-83ff-4a82-974e-9e086d6794bc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "cinder-quobyte-20de94d6-83ff-4a82-974e-9e086d6794bc" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-20de94d6-83ff-4a82-974e-9e086d6794bc" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2458f56a-b30b-4b61-917c-aa21bbce404d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:44 devstack sudo[105076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc Sep 03 12:08:44 devstack sudo[105076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:44 devstack sudo[105076]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc" returned: 0 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:44 devstack sudo[105081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc Sep 03 12:08:44 devstack sudo[105081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:44 devstack sudo[105081]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-20de94d6-83ff-4a82-974e-9e086d6794bc" returned: 0 in 0.236s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-quobyte-20de94d6-83ff-4a82-974e-9e086d6794bc" released by "delete_volume" :: held 0.621s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Created reservations ['c51129b8-df68-41b2-86f0-499b17eac2da', '28375245-8c26-40ec-b110-e351a4261a52', '2109e860-9ce9-495a-aebe-adc839cb7cf0', 'ad45ff07-7ace-4fd5-8aad-4d5220db9491'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:08:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:08:44 devstack sudo[105084]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:08:44 devstack sudo[105084]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:08:45 devstack sudo[105084]: pam_unix(sudo:session): session closed for user root Sep 03 12:08:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:08:45 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:08:45 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Deleted volume successfully. Sep 03 12:08:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a4a5e8df-622f-4156-a7bb-8ad1db997327 tempest-VolumeDependencyTests-485182322 None] Lock "cinder-20de94d6-83ff-4a82-974e-9e086d6794bc-delete_volume" released by "delete_volume" :: held 1.063s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:08:54 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=46,cinder:SELECT=42,cinder:INSERT=10,cinder:DELETE=3 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:08:55 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=34,cinder:UPDATE=38,cinder:INSERT=20,cinder:DELETE=4 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Flow 'volume_create_manager' (b59ffedd-fb9d-4211-a129-41214165274a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ee5d61-31b6-47b1-ae51-7a24329926d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (62ee5d61-31b6-47b1-ae51-7a24329926d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-791892531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac32fe-7903-49cb-8c0e-a7e6a57f86e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5cfd7fb5844a3ba239096696a78667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:15Z,use_quota=True,user_id='1aefe21986654fa09c17380785b6566b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e204f8d9-819f-489a-a09b-3c1b1fc0e4f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e204f8d9-819f-489a-a09b-3c1b1fc0e4f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0274daac-1340-4edc-a418-e14a72be9416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0274daac-1340-4edc-a418-e14a72be9416) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'caac32fe-7903-49cb-8c0e-a7e6a57f86e6', 'volume_name': 'volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e8e9cd-86c4-4fac-8865-4c3df9bfe6b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b4e8e9cd-86c4-4fac-8865-4c3df9bfe6b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc50204-5d57-46bd-b3e2-e24da06547cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:14 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Volume caac32fe-7903-49cb-8c0e-a7e6a57f86e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6', 'volume_size': 1} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-791892531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=caac32fe-7903-49cb-8c0e-a7e6a57f86e6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5cfd7fb5844a3ba239096696a78667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:15Z,use_quota=True,user_id='1aefe21986654fa09c17380785b6566b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Creating volume caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:14 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:14 devstack sudo[105091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 1073741824 Sep 03 12:09:14 devstack sudo[105091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:15 devstack sudo[105091]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 1073741824" returned: 0 in 0.429s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:15 devstack sudo[105096]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 Sep 03 12:09:15 devstack sudo[105096]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:15 devstack sudo[105096]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" returned: 0 in 0.244s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] <== create_volume: return (711ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9cc50204-5d57-46bd-b3e2-e24da06547cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4908dd-e8ab-4352-8aed-82d714e18aac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Volume volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 (caac32fe-7903-49cb-8c0e-a7e6a57f86e6): created successfully Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed4908dd-e8ab-4352-8aed-82d714e18aac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Flow 'volume_create_manager' (b59ffedd-fb9d-4211-a129-41214165274a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-db017acf-121b-405f-9e35-cd5634c89674 tempest-SnapshotDependencyTests-1528358027 None] Created volume successfully. Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Creating offline snapshot cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 of volume caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[577f3d7b-0edf-4f13-986f-faf4f8aff5a3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:15 devstack sudo[105099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 Sep 03 12:09:15 devstack sudo[105099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:16 devstack sudo[105099]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" returned: 0 in 0.346s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:16 devstack sudo[105104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 1G Sep 03 12:09:16 devstack sudo[105104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:16 devstack sudo[105106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:09:16 devstack sudo[105106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:16 devstack sudo[105106]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 29 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:09:16 devstack sudo[105104]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 1G" returned: 0 in 0.374s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:16 devstack sudo[105113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 Sep 03 12:09:16 devstack sudo[105113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:16 devstack sudo[105113]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:16 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 is being set with open permissions: ugo+rw Sep 03 12:09:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:16 devstack sudo[105118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 Sep 03 12:09:16 devstack sudo[105118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:17 devstack sudo[105118]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" returned: 0 in 0.238s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:17 devstack sudo[105121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.info Sep 03 12:09:17 devstack sudo[105121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:17 devstack sudo[105121]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.info" returned: 0 in 0.239s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:17 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.info is being set with open permissions: ugo+rw Sep 03 12:09:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:17 devstack sudo[105124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.info Sep 03 12:09:17 devstack sudo[105124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:17 devstack sudo[105124]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.info" returned: 0 in 0.234s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.810s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:17 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f856d237-0b76-4715-b0f1-f726fe01f142 tempest-SnapshotDependencyTests-1528358027 None] Create snapshot completed successfully Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Flow 'volume_create_manager' (06bcd02d-3c95-4a7e-87c8-c0bc0d7ff887) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dfa49d-3d02-460d-a6fe-b1284b2f3db5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (82dfa49d-3d02-460d-a6fe-b1284b2f3db5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:18Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f5cb832-fecf-4401-9017-ec491c561cb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='4b5cfd7fb5844a3ba239096696a78667',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=cfb53cff-ee9f-4a15-b60f-3c18e2ffad53,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:18Z,use_quota=True,user_id='1aefe21986654fa09c17380785b6566b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270ccbbf-74d0-4891-821b-af9c5c96e5ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (270ccbbf-74d0-4891-821b-af9c5c96e5ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093506a8-3e06-42fc-b508-9576da01b849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (093506a8-3e06-42fc-b508-9576da01b849) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6f5cb832-fecf-4401-9017-ec491c561cb7', 'volume_name': 'volume-6f5cb832-fecf-4401-9017-ec491c561cb7', 'volume_size': 1, 'snapshot_id': 'cfb53cff-ee9f-4a15-b60f-3c18e2ffad53'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ef4797-8496-4cfc-af80-a7ff92dea58a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (72ef4797-8496-4cfc-af80-a7ff92dea58a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d0e7c6-a8db-4d43-a5a3-9882602bf55d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Volume 6f5cb832-fecf-4401-9017-ec491c561cb7: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6f5cb832-fecf-4401-9017-ec491c561cb7', 'volume_size': 1, 'snapshot_id': 'cfb53cff-ee9f-4a15-b60f-3c18e2ffad53'} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-quobyte-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53-6f5cb832-fecf-4401-9017-ec491c561cb7" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53-6f5cb832-fecf-4401-9017-ec491c561cb7" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Creating volume 6f5cb832-fecf-4401-9017-ec491c561cb7 from snapshot cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-quobyte-6f5cb832-fecf-4401-9017-ec491c561cb7" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-6f5cb832-fecf-4401-9017-ec491c561cb7" acquired by "_copy_volume_from_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] snapshot: cfb53cff-ee9f-4a15-b60f-3c18e2ffad53, volume: 6f5cb832-fecf-4401-9017-ec491c561cb7, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffff6f2e-9ecd-44bf-827e-e12739925d48]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:18 devstack sudo[105127]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 Sep 03 12:09:18 devstack sudo[105127]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:19 devstack sudo[105127]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" returned: 0 in 0.351s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6ef7601-1a5f-4467-b402-10a78506c823]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:19 devstack sudo[105132]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 Sep 03 12:09:19 devstack sudo[105132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:19 devstack sudo[105132]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" returned: 0 in 0.354s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:09:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:19 devstack sudo[105138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 Sep 03 12:09:19 devstack sudo[105138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:23 devstack sudo[105138]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7" returned: 0 in 3.963s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6, size 1024.00 MB, duration 3.96 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:09:23 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Converted 1024.00 MB image at 258.33 MB/s Sep 03 12:09:23 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 is being set with open permissions: ugo+rw Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:23 devstack sudo[105154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 Sep 03 12:09:23 devstack sudo[105154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:23 devstack sudo[105154]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7" returned: 0 in 0.243s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-6f5cb832-fecf-4401-9017-ec491c561cb7" released by "_copy_volume_from_snapshot" :: held 5.024s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53-6f5cb832-fecf-4401-9017-ec491c561cb7" released by "_create_volume_from_snapshot" :: held 5.089s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.106s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5d0e7c6-a8db-4d43-a5a3-9882602bf55d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f5cb832-fecf-4401-9017-ec491c561cb7', 'volume_size': 1, 'snapshot_id': 'cfb53cff-ee9f-4a15-b60f-3c18e2ffad53'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ca9cb6-84ea-46da-91b3-9d22f3646242) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Volume volume-6f5cb832-fecf-4401-9017-ec491c561cb7 (6f5cb832-fecf-4401-9017-ec491c561cb7): created successfully Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6ca9cb6-84ea-46da-91b3-9d22f3646242) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Flow 'volume_create_manager' (06bcd02d-3c95-4a7e-87c8-c0bc0d7ff887) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9babc652-82f0-4bcc-9dd2-a87b67a73610 tempest-SnapshotDependencyTests-1528358027 None] Created volume successfully. Sep 03 12:09:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-quobyte-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-quobyte-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Deleting offline snapshot cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 of volume caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] snapshot_file for this snap is: volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[43f892c3-7bcb-4fc9-95ce-22e2c3c77154]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:24 devstack sudo[105158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 Sep 03 12:09:24 devstack sudo[105158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:24 devstack sudo[105158]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" returned: 0 in 0.350s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[89ba76a2-4812-4e4a-b609-de9d83ab9a44]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:24 devstack sudo[105164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 Sep 03 12:09:24 devstack sudo[105164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:24 devstack sudo[105164]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" returned: 0 in 0.528s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:24 devstack sudo[105170]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 Sep 03 12:09:24 devstack sudo[105170]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:25 devstack sudo[105170]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:25 devstack sudo[105175]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53 Sep 03 12:09:25 devstack sudo[105175]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:25 devstack sudo[105175]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6.cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" returned: 0 in 0.238s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53" released by "_delete_snapshot" :: held 1.529s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" released by "delete_snapshot" :: held 1.550s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:25 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Created reservations ['e1361390-3caf-42c0-8a4d-20bd629caa25', '6b95a392-51de-4b09-a396-478051f30059', 'e11b50d4-6f16-420a-8ff2-4d5c2c25e2ce', '812254dd-205f-42db-b3e1-c1759c86ad4d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:09:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Delete snapshot completed successfully. Sep 03 12:09:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d20ac957-095b-4749-9a32-862d44a74cd9 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-cfb53cff-ee9f-4a15-b60f-3c18e2ffad53-delete_snapshot" released by "delete_snapshot" :: held 1.670s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-caac32fe-7903-49cb-8c0e-a7e6a57f86e6-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-caac32fe-7903-49cb-8c0e-a7e6a57f86e6-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-quobyte-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" acquired by "delete_volume" :: waited 0.013s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[64fdad9f-25c3-4b16-9976-8bbd14ae5d9e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:26 devstack sudo[105178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 Sep 03 12:09:26 devstack sudo[105178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:26 devstack sudo[105178]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" returned: 0 in 0.341s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:26 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6 Sep 03 12:09:26 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:26 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" returned: 0 in 0.253s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-caac32fe-7903-49cb-8c0e-a7e6a57f86e6" released by "delete_volume" :: held 0.646s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Created reservations ['3ed6a718-b7e6-44a5-98ec-87a63eb3f86c', '51f949e2-41e3-442e-9df2-f15a42e70d2c', '51d26cd1-17a3-4334-b94e-e538d9f5c939', '43940d15-26ba-429e-ad9e-6bc2ae7fc8de'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:26 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:09:26 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:27 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:09:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Deleted volume successfully. Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-533434db-b0a5-48ff-8f65-df5c91aefe19 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-caac32fe-7903-49cb-8c0e-a7e6a57f86e6-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-6f5cb832-fecf-4401-9017-ec491c561cb7-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-6f5cb832-fecf-4401-9017-ec491c561cb7-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "cinder-quobyte-6f5cb832-fecf-4401-9017-ec491c561cb7" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-6f5cb832-fecf-4401-9017-ec491c561cb7" acquired by "delete_volume" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e8247f0-a89d-4be1-b33a-135b15729ff4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:27 devstack sudo[105189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 Sep 03 12:09:27 devstack sudo[105189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:27 devstack sudo[105189]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7" returned: 0 in 0.346s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:27 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7 Sep 03 12:09:27 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:27 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6f5cb832-fecf-4401-9017-ec491c561cb7" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-quobyte-6f5cb832-fecf-4401-9017-ec491c561cb7" released by "delete_volume" :: held 0.627s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Created reservations ['b8f435eb-bd91-49f2-8976-bd8f593a339e', 'c7dc2272-2ee6-478e-b4c2-e18fec421dd5', 'f5ecb9ef-ab14-4f96-aa5e-7c515932c98b', 'dde969e8-c448-4810-bcd1-80f7a7efb5bb'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:28 devstack sudo[105197]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:09:28 devstack sudo[105197]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:28 devstack sudo[105197]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.235s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:09:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Deleted volume successfully. Sep 03 12:09:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a67bf527-e827-447f-882d-a1616bee8724 tempest-SnapshotDependencyTests-1528358027 None] Lock "cinder-6f5cb832-fecf-4401-9017-ec491c561cb7-delete_volume" released by "delete_volume" :: held 1.046s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:38 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=28,cinder:UPDATE=32,cinder:DELETE=1,cinder:INSERT=5 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:09:38 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=26,cinder:SELECT=21,cinder:INSERT=10,cinder:DELETE=4 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Flow 'volume_create_manager' (4c973ec8-fd5f-4644-8147-a4fba632d447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b608f9-2b05-41c1-9d2d-0349b1ea5097) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b608f9-2b05-41c1-9d2d-0349b1ea5097) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a20474-c903-4e94-9b8a-434e53db460a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11a6a393bd14f8ab281e1037ceca460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:49Z,use_quota=True,user_id='8b129fe57da1477ca15f8e13f8f25157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60b6750-36c9-4a85-88b4-6d362a3c72a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c60b6750-36c9-4a85-88b4-6d362a3c72a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bbabfe-3ede-42e2-ac5e-da4d9c82864c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (95bbabfe-3ede-42e2-ac5e-da4d9c82864c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4a20474-c903-4e94-9b8a-434e53db460a', 'volume_name': 'volume-a4a20474-c903-4e94-9b8a-434e53db460a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f4ff37-0f0f-49be-be2c-4436cf95b8fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88f4ff37-0f0f-49be-be2c-4436cf95b8fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98754ec-9f77-4d22-aee4-9dfb6b6e29c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Volume a4a20474-c903-4e94-9b8a-434e53db460a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4a20474-c903-4e94-9b8a-434e53db460a', 'volume_size': 1} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4a20474-c903-4e94-9b8a-434e53db460a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11a6a393bd14f8ab281e1037ceca460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:49Z,use_quota=True,user_id='8b129fe57da1477ca15f8e13f8f25157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Creating volume a4a20474-c903-4e94-9b8a-434e53db460a {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:48 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:48 devstack sudo[105286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a 1073741824 Sep 03 12:09:48 devstack sudo[105286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Flow 'volume_create_manager' (217ae493-d39f-4c2c-8d0b-08540613f0ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64efcf5-1a22-475b-a4b7-6c5b728110e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c64efcf5-1a22-475b-a4b7-6c5b728110e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-339786563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d4fa71-e5c2-4c14-a888-2774614c9b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991886c2993e477f8f9e7f679286dc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:49Z,use_quota=True,user_id='e68ebb3c5add44f28f693b2ead30d69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf14ca47-6c90-4df0-ac13-9a5834760efe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf14ca47-6c90-4df0-ac13-9a5834760efe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05e770c-fa22-4999-a97c-b025dcd9c755) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f05e770c-fa22-4999-a97c-b025dcd9c755) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61d4fa71-e5c2-4c14-a888-2774614c9b3b', 'volume_name': 'volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d8a797-60cc-4595-8bb1-aa65ca216781) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d8a797-60cc-4595-8bb1-aa65ca216781) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af292700-8bfb-4ec3-856a-e37a2792a4ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:48 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Volume 61d4fa71-e5c2-4c14-a888-2774614c9b3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b', 'volume_size': 1} Sep 03 12:09:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:49 devstack sudo[105286]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a 1073741824" returned: 0 in 0.541s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:49 devstack sudo[105292]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a Sep 03 12:09:49 devstack sudo[105292]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (6f741a69-a248-4284-b046-2a5f54cd647d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e41e2dc-4273-4040-8523-d9bdf0dd909a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e41e2dc-4273-4040-8523-d9bdf0dd909a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1220132915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1e17f5-933b-4fed-b095-c9c3feb403f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:49Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3665411e-7d5e-48e6-9807-98e5df66b12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3665411e-7d5e-48e6-9807-98e5df66b12c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51994549-fbdf-4986-ba0a-62632b8f7bfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51994549-fbdf-4986-ba0a-62632b8f7bfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ea1e17f5-933b-4fed-b095-c9c3feb403f1', 'volume_name': 'volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d736655-bdcb-49e1-b59f-e6b268d7d235) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0d736655-bdcb-49e1-b59f-e6b268d7d235) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f28a081-2a94-4e91-bf5a-5aa6d763284a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Volume ea1e17f5-933b-4fed-b095-c9c3feb403f1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1', 'volume_size': 1} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:49 devstack sudo[105292]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a" returned: 0 in 0.332s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] <== create_volume: return (936ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.941s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.764s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-339786563',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61d4fa71-e5c2-4c14-a888-2774614c9b3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991886c2993e477f8f9e7f679286dc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:49Z,use_quota=True,user_id='e68ebb3c5add44f28f693b2ead30d69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Creating volume 61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:49 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c98754ec-9f77-4d22-aee4-9dfb6b6e29c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4a20474-c903-4e94-9b8a-434e53db460a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02df57a4-1408-4aa4-80f2-a4257be89851) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack sudo[105295]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b 1073741824 Sep 03 12:09:49 devstack sudo[105295]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Volume volume-a4a20474-c903-4e94-9b8a-434e53db460a (a4a20474-c903-4e94-9b8a-434e53db460a): created successfully Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (02df57a4-1408-4aa4-80f2-a4257be89851) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Flow 'volume_create_manager' (4c973ec8-fd5f-4644-8147-a4fba632d447) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (f7d81300-c5d3-4ea5-b92e-2e1f96b05a8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5f7e42-d1b7-4054-8d85-80fd0124a374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-41bf32ee-09f3-4440-9615-e813e0e2fca7 tempest-CinderUnicodeTest-178154017 None] Created volume successfully. Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0a5f7e42-d1b7-4054-8d85-80fd0124a374) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933645355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc202df4-85ad-4777-8aca-0eea6ccd0075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:50Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7921f500-300b-4cce-a84e-8629b5348a97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7921f500-300b-4cce-a84e-8629b5348a97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025118c9-caf1-4fa1-92a6-00de7cb345b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (025118c9-caf1-4fa1-92a6-00de7cb345b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc202df4-85ad-4777-8aca-0eea6ccd0075', 'volume_name': 'volume-fc202df4-85ad-4777-8aca-0eea6ccd0075', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce02158-3767-4b37-91f7-a83036d15b45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ce02158-3767-4b37-91f7-a83036d15b45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f459c52-4f58-440d-95a7-3c663d110225) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:49 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Volume fc202df4-85ad-4777-8aca-0eea6ccd0075: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc202df4-85ad-4777-8aca-0eea6ccd0075', 'volume_size': 1} Sep 03 12:09:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (4b1e5570-06a4-4492-a3a1-17a4155d8413) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f4d342-9d10-4faf-88ce-a25f0b31dc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (01f4d342-9d10-4faf-88ce-a25f0b31dc68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419471512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7429c8-b503-4a08-9424-df058a772046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:50Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1249cde4-dee2-47d4-8e22-7c83ca37a40c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1249cde4-dee2-47d4-8e22-7c83ca37a40c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf02b054-fba5-4d3e-a22c-e21c8f90c57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bf02b054-fba5-4d3e-a22c-e21c8f90c57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ad7429c8-b503-4a08-9424-df058a772046', 'volume_name': 'volume-ad7429c8-b503-4a08-9424-df058a772046', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack sudo[105295]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf04788-4dd5-418f-816c-685edfcaca76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bf04788-4dd5-418f-816c-685edfcaca76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5ec890-d94e-4df2-91fd-445642511c69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Volume ad7429c8-b503-4a08-9424-df058a772046: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ad7429c8-b503-4a08-9424-df058a772046', 'volume_size': 1} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b 1073741824" returned: 0 in 0.615s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:50 devstack sudo[105301]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b Sep 03 12:09:50 devstack sudo[105301]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (4c080530-a10d-4f3b-9f61-77be04783b31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5db7ff-2ead-4a20-8510-dd71bcfb48c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack sudo[105301]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b" returned: 0 in 0.337s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] <== create_volume: return (1001ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.004s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.123s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1220132915',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ea1e17f5-933b-4fed-b095-c9c3feb403f1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:49Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Creating volume ea1e17f5-933b-4fed-b095-c9c3feb403f1 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:50 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2b5db7ff-2ead-4a20-8510-dd71bcfb48c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-626296693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d925a29-a789-453d-ac76-cb29ec5d5f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:51Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack sudo[105304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 1073741824 Sep 03 12:09:50 devstack sudo[105304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a730ea-4116-48c9-877f-9335e35525ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (57a730ea-4116-48c9-877f-9335e35525ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53180b43-8b1d-4e83-b5fe-f6b710d20f63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (53180b43-8b1d-4e83-b5fe-f6b710d20f63) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2d925a29-a789-453d-ac76-cb29ec5d5f38', 'volume_name': 'volume-2d925a29-a789-453d-ac76-cb29ec5d5f38', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9d4872-7408-4fc2-9b92-1f79a73558a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ed9d4872-7408-4fc2-9b92-1f79a73558a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894521f0-aa34-4ba3-abc6-6634aa137d4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Volume 2d925a29-a789-453d-ac76-cb29ec5d5f38: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2d925a29-a789-453d-ac76-cb29ec5d5f38', 'volume_size': 1} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (af292700-8bfb-4ec3-856a-e37a2792a4ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4610cd6-a5bc-48fa-8e77-b09576b1e8e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:50 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Volume volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b (61d4fa71-e5c2-4c14-a888-2774614c9b3b): created successfully Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e4610cd6-a5bc-48fa-8e77-b09576b1e8e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:50 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Flow 'volume_create_manager' (217ae493-d39f-4c2c-8d0b-08540613f0ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:50 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d2582f12-6fc8-4f2d-8dc6-ab3763cdb76b tempest-VolumeDependencyTests-1771151447 None] Created volume successfully. Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (b381b960-25ce-47de-9615-32089d64231d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4075c17-fbcf-4314-baa9-559113affbd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b4075c17-fbcf-4314-baa9-559113affbd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1838175854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee37d970-79b2-4f8c-908d-4f922fd7a0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:51Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3589b1e-fcfc-4908-931b-95c710159669) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d3589b1e-fcfc-4908-931b-95c710159669) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bec655-453a-4dc9-ba78-f61c99e4c299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76bec655-453a-4dc9-ba78-f61c99e4c299) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee37d970-79b2-4f8c-908d-4f922fd7a0db', 'volume_name': 'volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65216529-baf8-4816-a883-a3f7c04cc36f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack sudo[105304]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (65216529-baf8-4816-a883-a3f7c04cc36f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd82aea7-4b92-455e-9387-6270f79e1ba1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Volume ee37d970-79b2-4f8c-908d-4f922fd7a0db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db', 'volume_size': 1} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 1073741824" returned: 0 in 0.649s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:51 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 Sep 03 12:09:51 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Flow 'volume_create_manager' (569ad9b8-0801-4b1f-88ec-36f6868d40f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17605d55-c9bf-4ba3-b917-729d43b80c9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (17605d55-c9bf-4ba3-b917-729d43b80c9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-492083538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5903f738-175b-483e-8764-4a4e42b240a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11a6a393bd14f8ab281e1037ceca460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:51Z,use_quota=True,user_id='8b129fe57da1477ca15f8e13f8f25157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ddc7a8-e519-4b54-a677-e698620d6fb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40ddc7a8-e519-4b54-a677-e698620d6fb6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b077a2-e884-4377-b295-ba4ebb620609) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (50b077a2-e884-4377-b295-ba4ebb620609) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5903f738-175b-483e-8764-4a4e42b240a1', 'volume_name': 'volume-5903f738-175b-483e-8764-4a4e42b240a1', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc06d9f-93f9-40c6-87ed-ccf84a33477e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4dc06d9f-93f9-40c6-87ed-ccf84a33477e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceee65db-82ec-40b6-a399-8da9cbac6c81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Volume 5903f738-175b-483e-8764-4a4e42b240a1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5903f738-175b-483e-8764-4a4e42b240a1', 'volume_size': 1} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:51 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1" returned: 0 in 0.258s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] <== create_volume: return (945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.948s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.772s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-933645355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc202df4-85ad-4777-8aca-0eea6ccd0075,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:50Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Creating volume fc202df4-85ad-4777-8aca-0eea6ccd0075 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:51 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:51 devstack sudo[105314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 1073741824 Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8f28a081-2a94-4e91-bf5a-5aa6d763284a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack sudo[105314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab29d7a0-d5d5-4746-9ff8-bafdefdd6874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Volume volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 (ea1e17f5-933b-4fed-b095-c9c3feb403f1): created successfully Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab29d7a0-d5d5-4746-9ff8-bafdefdd6874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (6f741a69-a248-4284-b046-2a5f54cd647d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-398b8d8a-6305-4ed5-9c8a-b2ed8ee78e01 tempest-CreateVolumesFromImageTest-623988624 None] Created volume successfully. Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:52 devstack sudo[105314]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 1073741824" returned: 0 in 0.531s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:52 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 Sep 03 12:09:52 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:52 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.188s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419471512',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ad7429c8-b503-4a08-9424-df058a772046,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:50Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Creating volume ad7429c8-b503-4a08-9424-df058a772046 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:52 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f459c52-4f58-440d-95a7-3c663d110225) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc202df4-85ad-4777-8aca-0eea6ccd0075', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:52 devstack sudo[105323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 1073741824 Sep 03 12:09:52 devstack sudo[105323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4190c377-249b-4544-acca-3ce22f88d595) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:52 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Volume volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 (fc202df4-85ad-4777-8aca-0eea6ccd0075): created successfully Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4190c377-249b-4544-acca-3ce22f88d595) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (f7d81300-c5d3-4ea5-b92e-2e1f96b05a8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-91e9ddaf-bbb4-4888-95ba-5e35246924bd tempest-CreateVolumesFromImageTest-623988624 None] Created volume successfully. Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Flow 'volume_create_manager' (78b183a0-45a6-4623-bb54-e8dc6dc4232e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd4459c-a5e4-46dd-906e-ba6efb33b0ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0bd4459c-a5e4-46dd-906e-ba6efb33b0ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4e884e-cc62-4f41-8b67-acd84c3f7152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50e8fdfae2fe4fcc986185864c773d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:53Z,use_quota=True,user_id='4bc21c10ffb9478e8720b0b084efaed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48eb0fc2-96f4-490a-88f7-f1fd7f708cb8),volume_type_id=48eb0fc2-96f4-490a-88f7-f1fd7f708cb8)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b811aed-8cde-4f01-8c4b-5c75a592fd91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b811aed-8cde-4f01-8c4b-5c75a592fd91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58fc71d-275d-4806-8783-2704e23c244d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:09:52 devstack sudo[105323]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 1073741824" returned: 0 in 0.458s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:53 devstack sudo[105329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 Sep 03 12:09:53 devstack sudo[105329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f58fc71d-275d-4806-8783-2704e23c244d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'cc4e884e-cc62-4f41-8b67-acd84c3f7152', 'volume_name': 'volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152', 'volume_size': 1, 'image_id': '649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ed2f19b6061c00e6c63cf8c89f6d5c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50e8fdfae2fe4fcc986185864c773d8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16b0e43bb6df0bf96af81ffd65705840fa92aa6539daea3d4e2a2d16851e3ac035c7bdb791a0bde3c1a506be6fc482a60d1a446ffe49fbb079da9295a5ef930f', 'id': '649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'created_at': datetime.datetime(2026, 9, 3, 10, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253f98d-98e2-4425-b1e5-6553a28621f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b253f98d-98e2-4425-b1e5-6553a28621f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4051606-fb08-48f8-a88f-4389965f4ede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Volume cc4e884e-cc62-4f41-8b67-acd84c3f7152: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152', 'volume_size': 1, 'image_id': '649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ed2f19b6061c00e6c63cf8c89f6d5c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50e8fdfae2fe4fcc986185864c773d8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16b0e43bb6df0bf96af81ffd65705840fa92aa6539daea3d4e2a2d16851e3ac035c7bdb791a0bde3c1a506be6fc482a60d1a446ffe49fbb079da9295a5ef930f', 'id': '649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'created_at': datetime.datetime(2026, 9, 3, 10, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Trying to clone cc4e884e-cc62-4f41-8b67-acd84c3f7152 from image 649bbc2d-92a4-4a91-959f-8c20aaac47d0 at location (None, [{'url': 'file:///opt/stack/data/glance/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:09:53 devstack sudo[105329]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.766s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:09:53 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Image download 0.00 MB at 0.00 MB/s Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.453s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-626296693',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2d925a29-a789-453d-ac76-cb29ec5d5f38,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:51Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Creating volume 2d925a29-a789-453d-ac76-cb29ec5d5f38 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e5ec890-d94e-4df2-91fd-445642511c69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ad7429c8-b503-4a08-9424-df058a772046', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:53 devstack sudo[105332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 1073741824 Sep 03 12:09:53 devstack sudo[105332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3fb125-d827-46c3-b417-8d846eca35ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6fa599f0-72dc-4ab5-b0fa-52bf3a4c27bc]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Volume volume-ad7429c8-b503-4a08-9424-df058a772046 (ad7429c8-b503-4a08-9424-df058a772046): created successfully Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef3fb125-d827-46c3-b417-8d846eca35ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (4b1e5570-06a4-4492-a3a1-17a4155d8413) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:53 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bbc392ea-29e9-48a3-8cfe-221efaaca78e tempest-CreateVolumesFromImageTest-623988624 None] Created volume successfully. Sep 03 12:09:53 devstack sudo[105334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD Sep 03 12:09:53 devstack sudo[105334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:53 devstack sudo[105334]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD" returned: 0 in 0.351s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:53 devstack sudo[105332]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 1073741824" returned: 0 in 0.432s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:53 devstack sudo[105343]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 Sep 03 12:09:53 devstack sudo[105343]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:53 devstack sudo[105342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD Sep 03 12:09:53 devstack sudo[105342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:53 devstack sudo[105343]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38" returned: 0 in 0.256s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] <== create_volume: return (733ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.736s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.657s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1838175854',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee37d970-79b2-4f8c-908d-4f922fd7a0db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d647297037ae4d0ea40a7ba477a43398',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:51Z,use_quota=True,user_id='09cad6799d3a4200882ef030e1d6c741',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Creating volume ee37d970-79b2-4f8c-908d-4f922fd7a0db {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:54 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:54 devstack sudo[105342]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD" returned: 1 in 0.342s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Temporary image 649bbc2d-92a4-4a91-959f-8c20aaac47d0 is fetched for user 4bc21c10ffb9478e8720b0b084efaed0. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:09:54 devstack sudo[105351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db 1073741824 Sep 03 12:09:54 devstack sudo[105351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (894521f0-aa34-4ba3-abc6-6634aa137d4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2d925a29-a789-453d-ac76-cb29ec5d5f38', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92180d4f-2157-44f7-a264-0c5134352bf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:54 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Volume volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 (2d925a29-a789-453d-ac76-cb29ec5d5f38): created successfully Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (92180d4f-2157-44f7-a264-0c5134352bf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (4c080530-a10d-4f3b-9f61-77be04783b31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e98c71c5-2f9d-40b8-a3b9-83577aec39fc tempest-CreateVolumesFromImageTest-623988624 None] Created volume successfully. Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[027b42bd-dd64-4a9d-a02f-d3852f0af57d]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:54 devstack sudo[105353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD Sep 03 12:09:54 devstack sudo[105353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:54 devstack sudo[105353]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD" returned: 0 in 0.339s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:54 devstack sudo[105351]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db 1073741824" returned: 0 in 0.487s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:54 devstack sudo[105360]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD Sep 03 12:09:54 devstack sudo[105361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db Sep 03 12:09:54 devstack sudo[105360]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:54 devstack sudo[105361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:54 devstack sudo[105360]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD" returned: 1 in 0.335s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:54 devstack sudo[105361]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db" returned: 0 in 0.257s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] <== create_volume: return (788ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.791s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.239s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:51Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-492083538',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5903f738-175b-483e-8764-4a4e42b240a1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d11a6a393bd14f8ab281e1037ceca460',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:51Z,use_quota=True,user_id='8b129fe57da1477ca15f8e13f8f25157',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Creating volume 5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:54 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cd82aea7-4b92-455e-9387-6270f79e1ba1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:54 devstack sudo[105368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 1073741824 Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fffc853-d1b1-417e-8d96-2743d92b763f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:54 devstack sudo[105368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:54 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Volume volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db (ee37d970-79b2-4f8c-908d-4f922fd7a0db): created successfully Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7fffc853-d1b1-417e-8d96-2743d92b763f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Flow 'volume_create_manager' (b381b960-25ce-47de-9615-32089d64231d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-4409046e-4ed8-4057-833f-f5688d4465cf tempest-CreateVolumesFromImageTest-623988624 None] Created volume successfully. Sep 03 12:09:55 devstack sudo[105368]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 1073741824" returned: 0 in 0.414s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:55 devstack sudo[105374]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 Sep 03 12:09:55 devstack sudo[105374]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:55 devstack sudo[105374]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1" returned: 0 in 0.237s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] <== create_volume: return (687ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.397s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceee65db-82ec-40b6-a399-8da9cbac6c81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5903f738-175b-483e-8764-4a4e42b240a1', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af80ae2-ce1d-4177-90e7-7768c501514c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Creating offline snapshot 189746b1-4118-436e-9d57-503d069af1ae of volume 61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:09:55 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Volume volume-5903f738-175b-483e-8764-4a4e42b240a1 (5903f738-175b-483e-8764-4a4e42b240a1): created successfully Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2af80ae2-ce1d-4177-90e7-7768c501514c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Flow 'volume_create_manager' (569ad9b8-0801-4b1f-88ec-36f6868d40f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdbacb8d-424e-42a7-98ae-0a078b10eef2]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c20d998b-522a-44be-b085-8d5ade332a35 tempest-CinderUnicodeTest-178154017 None] Created volume successfully. Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-ee37d970-79b2-4f8c-908d-4f922fd7a0db-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:55 devstack sudo[105377]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b Sep 03 12:09:55 devstack sudo[105377]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-ee37d970-79b2-4f8c-908d-4f922fd7a0db-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-quobyte-ee37d970-79b2-4f8c-908d-4f922fd7a0db" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-ee37d970-79b2-4f8c-908d-4f922fd7a0db" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4193f75-2a44-4a1d-a598-4ee9054a7c6e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:55 devstack sudo[105379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db Sep 03 12:09:55 devstack sudo[105379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:55 devstack sudo[105377]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b" returned: 0 in 0.446s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:56 devstack sudo[105384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae 1G Sep 03 12:09:56 devstack sudo[105384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:56 devstack sudo[105379]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db" returned: 0 in 0.392s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:56 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db Sep 03 12:09:56 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:56 devstack sudo[105384]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae 1G" returned: 0 in 0.395s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:56 devstack sudo[105395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae Sep 03 12:09:56 devstack sudo[105395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:56 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ee37d970-79b2-4f8c-908d-4f922fd7a0db" returned: 0 in 0.268s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-ee37d970-79b2-4f8c-908d-4f922fd7a0db" released by "delete_volume" :: held 0.708s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Created reservations ['656894ce-b9ff-4c0d-9af7-8babde525eb6', '6de9c0ae-f20d-4eaf-837e-4ca3962c75b8', 'd91d82b7-66d9-46e1-b9fd-d7a808d23df5', 'ad83dc34-3228-4253-870c-4f91d434cb03'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:56 devstack sudo[105397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:09:56 devstack sudo[105397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:56 devstack sudo[105395]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae" returned: 0 in 0.307s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:56 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae is being set with open permissions: ugo+rw Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:56 devstack sudo[105402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae Sep 03 12:09:56 devstack sudo[105402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:56 devstack sudo[105397]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-2d925a29-a789-453d-ac76-cb29ec5d5f38-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.278s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:09:56 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Deleted volume successfully. Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-2d925a29-a789-453d-ac76-cb29ec5d5f38-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2003778-1286-4c74-93f2-31fc9b717548 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-ee37d970-79b2-4f8c-908d-4f922fd7a0db-delete_volume" released by "delete_volume" :: held 1.231s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-quobyte-2d925a29-a789-453d-ac76-cb29ec5d5f38" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-2d925a29-a789-453d-ac76-cb29ec5d5f38" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2393b412-6b82-45d6-bfec-0200de1866fa]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:57 devstack sudo[105402]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae" returned: 0 in 0.301s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:57 devstack sudo[105407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.info Sep 03 12:09:57 devstack sudo[105407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:57 devstack sudo[105406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 Sep 03 12:09:57 devstack sudo[105406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:57 devstack sudo[105407]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.info" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:57 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.info is being set with open permissions: ugo+rw Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:57 devstack sudo[105414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.info Sep 03 12:09:57 devstack sudo[105414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:57 devstack sudo[105406]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38" returned: 0 in 0.368s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:57 devstack sudo[105416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38 Sep 03 12:09:57 devstack sudo[105416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:57 devstack sudo[105414]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.info" returned: 0 in 0.266s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.113s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.823s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:52Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc4e884e-cc62-4f41-8b67-acd84c3f7152,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='50e8fdfae2fe4fcc986185864c773d8a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:53Z,use_quota=True,user_id='4bc21c10ffb9478e8720b0b084efaed0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(48eb0fc2-96f4-490a-88f7-f1fd7f708cb8),volume_type_id=48eb0fc2-96f4-490a-88f7-f1fd7f708cb8)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Creating volume cc4e884e-cc62-4f41-8b67-acd84c3f7152 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:09:57 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:57 devstack sudo[105416]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:57 devstack sudo[105420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 1073741824 Sep 03 12:09:57 devstack sudo[105420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2d925a29-a789-453d-ac76-cb29ec5d5f38" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-2d925a29-a789-453d-ac76-cb29ec5d5f38" released by "delete_volume" :: held 0.701s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-78a262e6-8377-4920-9b72-b06aecfaf808 tempest-VolumeDependencyTests-1771151447 None] Create snapshot completed successfully Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Created reservations ['03a3132e-f0c3-4a73-a861-7c9dba73e220', '68bbebac-50b6-408e-91b8-7a42c018b641', 'b049d1c9-b99c-4408-86ae-cdb917a1d30d', '678ca32a-2f09-455e-a7f3-9ccb49144e78'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:57 devstack sudo[105422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:09:57 devstack sudo[105422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:58 devstack sudo[105422]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.281s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:09:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Deleted volume successfully. Sep 03 12:09:58 devstack sudo[105420]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 1073741824" returned: 0 in 0.471s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-ad7429c8-b503-4a08-9424-df058a772046-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ff00adf3-b48d-4c6b-83cd-c7283b254fea tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-2d925a29-a789-453d-ac76-cb29ec5d5f38-delete_volume" released by "delete_volume" :: held 1.240s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-ad7429c8-b503-4a08-9424-df058a772046-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:58 devstack sudo[105429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 Sep 03 12:09:58 devstack sudo[105429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-quobyte-ad7429c8-b503-4a08-9424-df058a772046" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-ad7429c8-b503-4a08-9424-df058a772046" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1518e29-911f-4349-b4ea-3a1dc31ff8bb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:58 devstack sudo[105431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 Sep 03 12:09:58 devstack sudo[105431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:58 devstack sudo[105429]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152" returned: 0 in 0.304s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.549s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Creating offline snapshot 9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 of volume 5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Attempting download of 649bbc2d-92a4-4a91-959f-8c20aaac47d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'metadata': {}}])) to volume cc4e884e-cc62-4f41-8b67-acd84c3f7152. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[15a7245c-306d-4a2c-9383-1537c52bfce5]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[18c88e61-f1c1-40a7-8540-7849b222defc]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_649bbc2d-92a4-4a91-959f-8c20aaac47d0_9h5zjg4i {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:58 devstack sudo[105434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 Sep 03 12:09:58 devstack sudo[105434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:58 devstack sudo[105431]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046" returned: 0 in 0.447s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:58 devstack sudo[105437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_649bbc2d-92a4-4a91-959f-8c20aaac47d0_9h5zjg4i Sep 03 12:09:58 devstack sudo[105437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:58 devstack sudo[105441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046 Sep 03 12:09:58 devstack sudo[105441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:58 devstack sudo[105437]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_649bbc2d-92a4-4a91-959f-8c20aaac47d0_9h5zjg4i" returned: 0 in 0.395s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649bbc2d-92a4-4a91-959f-8c20aaac47d0_9h5zjg4i {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:58 devstack sudo[105434]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1" returned: 0 in 0.476s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:59 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 1G Sep 03 12:09:59 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:59 devstack sudo[105449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649bbc2d-92a4-4a91-959f-8c20aaac47d0_9h5zjg4i Sep 03 12:09:59 devstack sudo[105449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:59 devstack sudo[105441]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ad7429c8-b503-4a08-9424-df058a772046" returned: 0 in 0.470s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-ad7429c8-b503-4a08-9424-df058a772046" released by "delete_volume" :: held 0.974s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Flow 'volume_create_manager' (de0946f7-9ea7-475e-a781-0068578bbba4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ead27d2-41eb-4259-b39b-a4eb092172a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1ead27d2-41eb-4259-b39b-a4eb092172a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:09:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-1402600461',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6b83f347-ebe3-4cf1-bec5-aa2d6426d50b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='991886c2993e477f8f9e7f679286dc3c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:09:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=189746b1-4118-436e-9d57-503d069af1ae,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:09:59Z,use_quota=True,user_id='e68ebb3c5add44f28f693b2ead30d69e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8eef31-33dc-4dc3-b63a-ad4eaffe8917) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a8eef31-33dc-4dc3-b63a-ad4eaffe8917) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a7b9dc-ba53-4745-a41a-0fa62eeffd38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a7b9dc-ba53-4745-a41a-0fa62eeffd38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6b83f347-ebe3-4cf1-bec5-aa2d6426d50b', 'volume_name': 'volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b', 'volume_size': 1, 'snapshot_id': '189746b1-4118-436e-9d57-503d069af1ae'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f910f654-299e-4ca7-a0b6-d9f8c434d4b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f910f654-299e-4ca7-a0b6-d9f8c434d4b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdc22fd-d1bc-46e5-8117-3f2e3295154a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:09:59 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Volume 6b83f347-ebe3-4cf1-bec5-aa2d6426d50b: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b', 'volume_size': 1, 'snapshot_id': '189746b1-4118-436e-9d57-503d069af1ae'} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Created reservations ['884baf45-11ba-4b78-8dd2-636244e341c6', '76ccfa9f-a9d5-4ec7-bcf3-06696fdcdac0', '14dda754-f7a4-4215-962a-1b98207e6287', '562b4c2d-cc2d-44ec-925a-dcf4ff226e55'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:59 devstack sudo[105449]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649bbc2d-92a4-4a91-959f-8c20aaac47d0_9h5zjg4i" returned: 1 in 0.415s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_649bbc2d-92a4-4a91-959f-8c20aaac47d0_9h5zjg4i' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8977834-8bf3-4487-b598-f0bb941ed71f]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:59 devstack sudo[105459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:09:59 devstack sudo[105459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:59 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 1G" returned: 0 in 0.517s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5903f738-175b-483e-8764-4a4e42b240a1 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:59 devstack sudo[105460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD Sep 03 12:09:59 devstack sudo[105460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:59 devstack sudo[105463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5903f738-175b-483e-8764-4a4e42b240a1 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 Sep 03 12:09:59 devstack sudo[105463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:59 devstack sudo[105459]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.273s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:09:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Deleted volume successfully. Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7f403e4b-b739-4a4d-ba46-dabb556ec320 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-ad7429c8-b503-4a08-9424-df058a772046-delete_volume" released by "delete_volume" :: held 1.543s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:09:59 devstack sudo[105460]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD" returned: 0 in 0.356s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:59 devstack sudo[105463]: pam_unix(sudo:session): session closed for user root Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5903f738-175b-483e-8764-4a4e42b240a1 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:09:59 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 is being set with open permissions: ugo+rw Sep 03 12:09:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:09:59 devstack sudo[105473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 Sep 03 12:09:59 devstack sudo[105473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:09:59 devstack sudo[105472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD Sep 03 12:09:59 devstack sudo[105472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:00 devstack sudo[105473]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" returned: 0 in 0.272s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:00 devstack sudo[105472]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD" returned: 1 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] 649bbc2d-92a4-4a91-959f-8c20aaac47d0 was raw, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:00 devstack sudo[105480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 Sep 03 12:10:00 devstack sudo[105480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:00 devstack sudo[105482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.info Sep 03 12:10:00 devstack sudo[105482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-fc202df4-85ad-4777-8aca-0eea6ccd0075-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-fc202df4-85ad-4777-8aca-0eea6ccd0075-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-quobyte-fc202df4-85ad-4777-8aca-0eea6ccd0075" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:00 devstack sudo[105482]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-fc202df4-85ad-4777-8aca-0eea6ccd0075" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.info" returned: 0 in 0.316s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:00 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.info is being set with open permissions: ugo+rw Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[80d290a4-1fc2-43df-a957-981a257af22b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:00 devstack sudo[105488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.info Sep 03 12:10:00 devstack sudo[105488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:00 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 Sep 03 12:10:00 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:00 devstack sudo[105480]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152" returned: 0 in 0.514s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_649bbc2d-92a4-4a91-959f-8c20aaac47d0_5yhcs09bdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:10:00 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:00 devstack sudo[105493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 1G Sep 03 12:10:00 devstack sudo[105493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:00 devstack sudo[105488]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.info" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.288s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 1.464s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-quobyte-189746b1-4118-436e-9d57-503d069af1ae-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:00 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3455bc83-422b-4ad3-b938-bc9de8a6a950 tempest-CinderUnicodeTest-178154017 None] Create snapshot completed successfully Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-189746b1-4118-436e-9d57-503d069af1ae-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" acquired by "_create_volume_from_snapshot" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Creating volume 6b83f347-ebe3-4cf1-bec5-aa2d6426d50b from snapshot 189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-quobyte-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" acquired by "_copy_volume_from_snapshot" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] snapshot: 189746b1-4118-436e-9d57-503d069af1ae, volume: 6b83f347-ebe3-4cf1-bec5-aa2d6426d50b, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:10:00 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075" returned: 0 in 0.403s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[79def691-fce6-47d9-9ba2-523d1259b18a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:00 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075 Sep 03 12:10:00 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:00 devstack sudo[105493]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 1G" returned: 0 in 0.366s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Downloaded image 649bbc2d-92a4-4a91-959f-8c20aaac47d0 ((None, [{'url': 'file:///opt/stack/data/glance/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'metadata': {}}])) to volume cc4e884e-cc62-4f41-8b67-acd84c3f7152 successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Temporary image 649bbc2d-92a4-4a91-959f-8c20aaac47d0 for user 4bc21c10ffb9478e8720b0b084efaed0 is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:10:00 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Marking volume cc4e884e-cc62-4f41-8b67-acd84c3f7152 as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Copying metadata from image 649bbc2d-92a4-4a91-959f-8c20aaac47d0 to cc4e884e-cc62-4f41-8b67-acd84c3f7152. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Creating volume glance metadata for volume cc4e884e-cc62-4f41-8b67-acd84c3f7152 backed by image 649bbc2d-92a4-4a91-959f-8c20aaac47d0 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': '649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '5ed2f19b6061c00e6c63cf8c89f6d5c3', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:10:01 devstack sudo[105504]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae Sep 03 12:10:01 devstack sudo[105504]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4051606-fb08-48f8-a88f-4389965f4ede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152', 'volume_size': 1, 'image_id': '649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '5ed2f19b6061c00e6c63cf8c89f6d5c3', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '50e8fdfae2fe4fcc986185864c773d8a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '16b0e43bb6df0bf96af81ffd65705840fa92aa6539daea3d4e2a2d16851e3ac035c7bdb791a0bde3c1a506be6fc482a60d1a446ffe49fbb079da9295a5ef930f', 'id': '649bbc2d-92a4-4a91-959f-8c20aaac47d0', 'created_at': datetime.datetime(2026, 9, 3, 10, 9, 50, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 9, 52, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/649bbc2d-92a4-4a91-959f-8c20aaac47d0/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c637cc3-077e-49d8-951a-035ec863221d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:01 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Volume volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 (cc4e884e-cc62-4f41-8b67-acd84c3f7152): created successfully Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3c637cc3-077e-49d8-951a-035ec863221d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Flow 'volume_create_manager' (78b183a0-45a6-4623-bb54-e8dc6dc4232e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9d8c1514-9068-4eef-b719-763bf1448476 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Created volume successfully. Sep 03 12:10:01 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fc202df4-85ad-4777-8aca-0eea6ccd0075" returned: 0 in 0.309s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-fc202df4-85ad-4777-8aca-0eea6ccd0075" released by "delete_volume" :: held 0.762s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "cinder-9afc99b6-e3a8-48af-aabc-28f2f5ada0b4-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Created reservations ['51cb9283-d071-45ea-b545-ea5ced208fc3', 'f2f3461a-0bef-4e5f-ae86-6042fa99e3a5', 'ba396655-5aee-4678-be1b-80f0ae4f6d83', 'ddec20a6-248e-4ef3-bee4-9d3c5d28b7e5'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-9afc99b6-e3a8-48af-aabc-28f2f5ada0b4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "cinder-quobyte-5903f738-175b-483e-8764-4a4e42b240a1" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-5903f738-175b-483e-8764-4a4e42b240a1" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "cinder-quobyte-9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:01 devstack sudo[105504]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae" returned: 0 in 0.453s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Deleting offline snapshot 9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 of volume 5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] snapshot_file for this snap is: volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[09321a3d-bcc6-471f-9770-8ba231d90e76]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Acquiring lock "cinder-cc4e884e-cc62-4f41-8b67-acd84c3f7152-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0e85e954-9fb7-40a2-9ab6-9cfed0934ef0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "cinder-cc4e884e-cc62-4f41-8b67-acd84c3f7152-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:01 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:01 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Acquiring lock "cinder-quobyte-cc4e884e-cc62-4f41-8b67-acd84c3f7152" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:01 devstack sudo[105514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 Sep 03 12:10:01 devstack sudo[105514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-ea1e17f5-933b-4fed-b095-c9c3feb403f1-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "cinder-quobyte-cc4e884e-cc62-4f41-8b67-acd84c3f7152" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:01 devstack sudo[105513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b Sep 03 12:10:01 devstack sudo[105513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-ea1e17f5-933b-4fed-b095-c9c3feb403f1-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc967527-e99f-42a9-9cbd-94599de2a371]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "cinder-quobyte-ea1e17f5-933b-4fed-b095-c9c3feb403f1" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-ea1e17f5-933b-4fed-b095-c9c3feb403f1" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ba892db-570f-4e13-8ad0-a97acf1eea41]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:01 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Deleted volume successfully. Sep 03 12:10:01 devstack sudo[105514]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:01 devstack sudo[105519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 Sep 03 12:10:01 devstack sudo[105519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" returned: 0 in 0.441s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5903f738-175b-483e-8764-4a4e42b240a1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3a73cba0-3e1c-4951-ad6e-88bb9ad391d8 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-fc202df4-85ad-4777-8aca-0eea6ccd0075-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f143036f-9490-4d93-a2e4-52d214ec0b08]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:01 devstack sudo[105522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 Sep 03 12:10:01 devstack sudo[105522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:01 devstack sudo[105513]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b" returned: 0 in 0.540s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:10:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:01 devstack sudo[105531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b Sep 03 12:10:01 devstack sudo[105531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:02 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 Sep 03 12:10:02 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:02 devstack sudo[105519]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152" returned: 0 in 0.531s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:02 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152 Sep 03 12:10:02 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:02 devstack sudo[105522]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1" returned: 0 in 0.508s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:02 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1" returned: 0 in 0.408s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:02 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1 Sep 03 12:10:02 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:02 devstack sudo[105552]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 Sep 03 12:10:02 devstack sudo[105552]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:02 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc4e884e-cc62-4f41-8b67-acd84c3f7152" returned: 0 in 0.293s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "cinder-quobyte-cc4e884e-cc62-4f41-8b67-acd84c3f7152" released by "delete_volume" :: held 0.921s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:02 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-ea1e17f5-933b-4fed-b095-c9c3feb403f1" returned: 0 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-quobyte-ea1e17f5-933b-4fed-b095-c9c3feb403f1" released by "delete_volume" :: held 0.957s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Created reservations ['d17c9d49-f100-4905-add1-82ba65d09389', '767fdf9c-6c02-463c-8423-1f9e580ada8f', '47f2e02d-bfdd-4180-bae5-dcc8a2930146', 'f00fab39-f9de-44bc-859e-9495c89c02c0'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Created reservations ['58f7ae42-9354-4312-b486-0b1092649d6a', '691ce64a-72a6-4025-9064-c5fd0d43a6a4', 'b05f7118-bf5c-4c5d-bfbb-36d877d53f72', '9e8059c0-f17d-4a01-b1b3-52d920681f72'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:03 devstack sudo[105565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:03 devstack sudo[105565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:03 devstack sudo[105552]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" returned: 0 in 0.846s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:03 devstack sudo[105567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:03 devstack sudo[105567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:03 devstack sudo[105568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4 Sep 03 12:10:03 devstack sudo[105568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:03 devstack sudo[105567]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.588s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Deleted volume successfully. Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-dfaf74b6-4444-4cef-b93e-0d603a47fe79 tempest-CreateVolumesFromImageTest-623988624 None] Lock "cinder-ea1e17f5-933b-4fed-b095-c9c3feb403f1-delete_volume" released by "delete_volume" :: held 2.195s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:03 devstack sudo[105565]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.883s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:03 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Deleted volume successfully. Sep 03 12:10:03 devstack sudo[105568]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1.9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" returned: 0 in 0.768s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a50434a0-2226-47af-a343-0ae23d71eb45 tempest-VolumeAndVolumeTypeFromImageTest-122623169 None] Lock "cinder-cc4e884e-cc62-4f41-8b67-acd84c3f7152-delete_volume" released by "delete_volume" :: held 2.457s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-9afc99b6-e3a8-48af-aabc-28f2f5ada0b4" released by "_delete_snapshot" :: held 2.696s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-5903f738-175b-483e-8764-4a4e42b240a1" released by "delete_snapshot" :: held 2.758s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Created reservations ['45a7b8e0-7eab-4836-94eb-29ae83f4ba15', '42dc7b56-5cb2-4c84-b8a3-1da3773c99b2', '9a8a601e-72b3-4ed3-891b-a409fe9dc27d', '34544d2d-a1d9-4c38-82fd-264bf703fa72'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Delete snapshot completed successfully. Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f2d1fea-c0d5-4fa9-a7d1-7db0d9189342 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-9afc99b6-e3a8-48af-aabc-28f2f5ada0b4-delete_snapshot" released by "delete_snapshot" :: held 3.137s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "cinder-5903f738-175b-483e-8764-4a4e42b240a1-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-5903f738-175b-483e-8764-4a4e42b240a1-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "cinder-quobyte-5903f738-175b-483e-8764-4a4e42b240a1" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-5903f738-175b-483e-8764-4a4e42b240a1" acquired by "delete_volume" :: waited 0.059s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c3b6a60-5d86-403e-aae4-f8a95c7617d5]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:05 devstack sudo[105576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 Sep 03 12:10:05 devstack sudo[105576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:06 devstack sudo[105576]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1" returned: 0 in 1.096s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:06 devstack sudo[105581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1 Sep 03 12:10:06 devstack sudo[105581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:06 devstack sudo[105581]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5903f738-175b-483e-8764-4a4e42b240a1" returned: 0 in 0.605s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-5903f738-175b-483e-8764-4a4e42b240a1" released by "delete_volume" :: held 1.886s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:06 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Created reservations ['f558405a-ceb3-4a15-9677-7b442107a24a', '11203e95-bfb0-47c4-89d8-73378e871af6', 'e8e86261-8d82-43c5-b998-72b68540f64a', '4e4577f9-5f89-4f94-be1a-247a577cf0ad'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:07 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:07 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Acquiring lock "cinder-a4a20474-c903-4e94-9b8a-434e53db460a-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Lock "cinder-a4a20474-c903-4e94-9b8a-434e53db460a-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Acquiring lock "cinder-quobyte-a4a20474-c903-4e94-9b8a-434e53db460a" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-a4a20474-c903-4e94-9b8a-434e53db460a" acquired by "delete_volume" :: waited 0.060s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b126277d-0533-43fb-b87e-0c24a0c8658e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:07 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.594s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Deleted volume successfully. Sep 03 12:10:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d1cc8a3f-4b6c-412c-abbd-338e0f806149 tempest-CinderUnicodeTest-178154017 None] Lock "cinder-5903f738-175b-483e-8764-4a4e42b240a1-delete_volume" released by "delete_volume" :: held 3.137s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:07 devstack sudo[105587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a Sep 03 12:10:07 devstack sudo[105587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:08 devstack sudo[105531]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" returned: 0 in 6.167s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b, size 1024.00 MB, duration 6.17 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:10:08 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Converted 1024.00 MB image at 166.03 MB/s Sep 03 12:10:08 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b is being set with open permissions: ugo+rw Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:08 devstack sudo[105589]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b Sep 03 12:10:08 devstack sudo[105589]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:08 devstack sudo[105587]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a" returned: 0 in 0.684s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:08 devstack sudo[105594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a Sep 03 12:10:08 devstack sudo[105594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:08 devstack sudo[105589]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" returned: 0 in 0.318s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" released by "_copy_volume_from_snapshot" :: held 7.634s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-189746b1-4118-436e-9d57-503d069af1ae-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" released by "_create_volume_from_snapshot" :: held 7.728s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.769s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fdc22fd-d1bc-46e5-8117-3f2e3295154a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b', 'volume_size': 1, 'snapshot_id': '189746b1-4118-436e-9d57-503d069af1ae'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf2f638-4a08-465d-922d-1d261e45567f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:08 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Volume volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b (6b83f347-ebe3-4cf1-bec5-aa2d6426d50b): created successfully Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fbf2f638-4a08-465d-922d-1d261e45567f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Flow 'volume_create_manager' (de0946f7-9ea7-475e-a781-0068578bbba4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:08 devstack sudo[105594]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a4a20474-c903-4e94-9b8a-434e53db460a" returned: 0 in 0.307s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8e40e1b4-63cc-48ad-80dd-ae750ef422a6 tempest-VolumeDependencyTests-1771151447 None] Created volume successfully. Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Lock "cinder-quobyte-a4a20474-c903-4e94-9b8a-434e53db460a" released by "delete_volume" :: held 1.093s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Created reservations ['eb3a8b80-5491-4b39-9d2a-f5cb52b91ba3', '344a00d9-6ad4-4d07-a8a5-83107bfc87b7', 'c8ff10a4-7dac-4013-8544-f3aae594139f', '633e4a44-0d56-4f12-91ad-1aa9fec348e0'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:08 devstack sudo[105598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:08 devstack sudo[105598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:09 devstack sudo[105598]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.252s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Deleted volume successfully. Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4359100-75a9-4b99-9514-851182e21ddc tempest-CinderUnicodeTest-178154017 None] Lock "cinder-a4a20474-c903-4e94-9b8a-434e53db460a-delete_volume" released by "delete_volume" :: held 1.708s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-189746b1-4118-436e-9d57-503d069af1ae-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-189746b1-4118-436e-9d57-503d069af1ae-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-quobyte-61d4fa71-e5c2-4c14-a888-2774614c9b3b" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-61d4fa71-e5c2-4c14-a888-2774614c9b3b" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-quobyte-189746b1-4118-436e-9d57-503d069af1ae" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-189746b1-4118-436e-9d57-503d069af1ae" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Deleting offline snapshot 189746b1-4118-436e-9d57-503d069af1ae of volume 61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] snapshot_file for this snap is: volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[819ef8c3-52f2-4b79-af70-dbd19f3f022d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:09 devstack sudo[105601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae Sep 03 12:10:09 devstack sudo[105601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:09 devstack sudo[105601]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae" returned: 0 in 0.420s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ebfab58e-2af9-4869-82d1-c6c9f73db763]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:09 devstack sudo[105607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b Sep 03 12:10:09 devstack sudo[105607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:10 devstack sudo[105607]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b" returned: 0 in 0.647s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:10 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae Sep 03 12:10:10 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (08c39b70-09b1-478e-ae2e-c5eff9be17a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5ef700-1d08-4803-b491-a859d6d4b549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b5ef700-1d08-4803-b491-a859d6d4b549) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-278976979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61881f0c-6820-4da8-b037-33ee91d271f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:11Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8677b3af-4a2b-422e-be77-390eb86457a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8677b3af-4a2b-422e-be77-390eb86457a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6074bf97-98f6-4094-a2f4-139c1ee83a8f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6074bf97-98f6-4094-a2f4-139c1ee83a8f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '61881f0c-6820-4da8-b037-33ee91d271f7', 'volume_name': 'volume-61881f0c-6820-4da8-b037-33ee91d271f7', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ef7d06-86b1-4cf7-855f-b96515b4bf8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25ef7d06-86b1-4cf7-855f-b96515b4bf8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23bd3ac-6c33-4827-a6e1-83bd8fc3f782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:10 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume 61881f0c-6820-4da8-b037-33ee91d271f7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-61881f0c-6820-4da8-b037-33ee91d271f7', 'volume_size': 1} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-278976979',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=61881f0c-6820-4da8-b037-33ee91d271f7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:11Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Creating volume 61881f0c-6820-4da8-b037-33ee91d271f7 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:10 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:10 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 1073741824 Sep 03 12:10:10 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:10 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae" returned: 0 in 0.487s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:10 devstack sudo[105620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae Sep 03 12:10:10 devstack sudo[105620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:11 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 1073741824" returned: 0 in 0.565s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:11 devstack sudo[105620]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b.189746b1-4118-436e-9d57-503d069af1ae" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-189746b1-4118-436e-9d57-503d069af1ae" released by "_delete_snapshot" :: held 2.009s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-61d4fa71-e5c2-4c14-a888-2774614c9b3b" released by "delete_snapshot" :: held 2.056s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:11 devstack sudo[105627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 Sep 03 12:10:11 devstack sudo[105627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Created reservations ['b4decc81-708d-4d2d-9662-888df6b1d555', '0c6a983c-c048-4f6b-b0f7-f473dd02cee5', 'f9b2ebe4-5aef-4b08-8612-e66d4b7826bc', 'd7faa38d-ce90-409c-a267-d314b03ffacc'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Delete snapshot completed successfully. Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d4608871-3544-4477-b4fb-9990a826856c tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-189746b1-4118-436e-9d57-503d069af1ae-delete_snapshot" released by "delete_snapshot" :: held 2.312s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:11 devstack sudo[105627]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] <== create_volume: return (993ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a23bd3ac-6c33-4827-a6e1-83bd8fc3f782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-61881f0c-6820-4da8-b037-33ee91d271f7', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0804a39-352d-486f-8468-1462927d120e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:11 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume volume-61881f0c-6820-4da8-b037-33ee91d271f7 (61881f0c-6820-4da8-b037-33ee91d271f7): created successfully Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0804a39-352d-486f-8468-1462927d120e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:11 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (08c39b70-09b1-478e-ae2e-c5eff9be17a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fee161ee-b638-4953-ab32-107e4f58c29c tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created volume successfully. Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (432802fc-8e89-4ebc-a375-025fc199d98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5105550-1da3-4190-b683-bf0a66ed745c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5105550-1da3-4190-b683-bf0a66ed745c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493834423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d75764-1d47-48ec-b4b9-3adf5e895797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:12Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0c99f1-4aef-4aec-818f-104238041033) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce0c99f1-4aef-4aec-818f-104238041033) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489a88dc-36cc-4dbf-b21b-a1d245c22c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (489a88dc-36cc-4dbf-b21b-a1d245c22c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5d75764-1d47-48ec-b4b9-3adf5e895797', 'volume_name': 'volume-c5d75764-1d47-48ec-b4b9-3adf5e895797', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e45c8-0054-4325-a93a-0d99dd7b9b29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f3e45c8-0054-4325-a93a-0d99dd7b9b29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b14550-b036-4dde-8fb8-91bd60d515ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:12 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume c5d75764-1d47-48ec-b4b9-3adf5e895797: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5d75764-1d47-48ec-b4b9-3adf5e895797', 'volume_size': 1} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-493834423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5d75764-1d47-48ec-b4b9-3adf5e895797,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:12Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Creating volume c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:12 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:12 devstack sudo[105630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 1073741824 Sep 03 12:10:12 devstack sudo[105630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-61d4fa71-e5c2-4c14-a888-2774614c9b3b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-61d4fa71-e5c2-4c14-a888-2774614c9b3b-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-quobyte-61d4fa71-e5c2-4c14-a888-2774614c9b3b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-61d4fa71-e5c2-4c14-a888-2774614c9b3b" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[196458c8-3777-4bd0-8a86-600791d2d2ec]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:12 devstack sudo[105635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b Sep 03 12:10:12 devstack sudo[105635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:12 devstack sudo[105630]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 1073741824" returned: 0 in 0.581s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:12 devstack sudo[105638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 Sep 03 12:10:12 devstack sudo[105638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:13 devstack sudo[105638]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797" returned: 0 in 0.283s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e1b14550-b036-4dde-8fb8-91bd60d515ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5d75764-1d47-48ec-b4b9-3adf5e895797', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09253605-8104-4f9f-aa19-0d863b75e28d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack sudo[105635]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b" returned: 0 in 0.573s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:13 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 (c5d75764-1d47-48ec-b4b9-3adf5e895797): created successfully Sep 03 12:10:13 devstack sudo[105644]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b Sep 03 12:10:13 devstack sudo[105644]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09253605-8104-4f9f-aa19-0d863b75e28d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (432802fc-8e89-4ebc-a375-025fc199d98b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:13 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-952372ed-4f75-4a5b-901b-a9f81bcc0e8d tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created volume successfully. Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (e4be5527-feed-4f3e-b712-5b1d8536ae1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395d2993-7ca7-4e31-86c5-6580839cb8d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (395d2993-7ca7-4e31-86c5-6580839cb8d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682407081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d85461-e3dc-4dad-bc4a-1f81515050ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:13Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68485ffd-4145-43d8-a1c0-73de5a52606b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68485ffd-4145-43d8-a1c0-73de5a52606b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bd2139-b933-430e-90f2-1269e6911433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f4bd2139-b933-430e-90f2-1269e6911433) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6d85461-e3dc-4dad-bc4a-1f81515050ec', 'volume_name': 'volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd5dd64-d706-4b42-b64a-5b13946a524a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd5dd64-d706-4b42-b64a-5b13946a524a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad5af27-7f31-4ca8-b559-a8be8563f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume a6d85461-e3dc-4dad-bc4a-1f81515050ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec', 'volume_size': 1} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-682407081',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6d85461-e3dc-4dad-bc4a-1f81515050ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:13Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Creating volume a6d85461-e3dc-4dad-bc4a-1f81515050ec {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:13 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:13 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec 1073741824 Sep 03 12:10:13 devstack sudo[105644]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:13 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61d4fa71-e5c2-4c14-a888-2774614c9b3b" returned: 0 in 0.340s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-61d4fa71-e5c2-4c14-a888-2774614c9b3b" released by "delete_volume" :: held 0.991s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Created reservations ['08851101-8989-436f-a384-b2b9c786ef2d', '1631eb12-fe74-4f1d-b72d-87fe33aacdab', '3e5d3adf-3ee2-4e0e-9a92-8fc1afea0614', '9aa2bead-7955-4f4d-919d-9dea1d53197d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (6c0f690d-22cc-4d1e-a89c-4fe3e459f4ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f5d404-8466-487d-95e7-1da40bed335e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47f5d404-8466-487d-95e7-1da40bed335e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105859375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb941a1-73ef-424a-81a3-aad7f2a8b082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:14Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897a8318-3a6e-4288-a826-d8a6ed36e347) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (897a8318-3a6e-4288-a826-d8a6ed36e347) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb003714-6acb-4d94-909f-808a3f8d6163) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cb003714-6acb-4d94-909f-808a3f8d6163) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bcb941a1-73ef-424a-81a3-aad7f2a8b082', 'volume_name': 'volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7522c0-72ad-4694-9936-6f8f0b0b4c04) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bb7522c0-72ad-4694-9936-6f8f0b0b4c04) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d93898-9989-4d6d-873f-e8fb6d9f28a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:13 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume bcb941a1-73ef-424a-81a3-aad7f2a8b082: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082', 'volume_size': 1} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:13 devstack sudo[105653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:13 devstack sudo[105653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:14 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec 1073741824" returned: 0 in 0.702s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:14 devstack sudo[105653]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (579abcf1-1876-4e3c-82fd-5338ed742b86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a58902-7f7f-4f3b-bf28-7368fe7fbf22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.415s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Deleted volume successfully. Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c5a58902-7f7f-4f3b-bf28-7368fe7fbf22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860763010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd98d144-1fb7-4213-a887-3abc105da108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:14Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9708bea-0ce6-4fcd-96b7-cbd881cba438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d9708bea-0ce6-4fcd-96b7-cbd881cba438) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:14 devstack sudo[105657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec Sep 03 12:10:14 devstack sudo[105657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f492648-7e39-4e43-bf2a-d1829da862d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7f492648-7e39-4e43-bf2a-d1829da862d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd98d144-1fb7-4213-a887-3abc105da108', 'volume_name': 'volume-bd98d144-1fb7-4213-a887-3abc105da108', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55ce3f6-ce3a-4134-ba47-3b6324c782fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e55ce3f6-ce3a-4134-ba47-3b6324c782fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a57a6a-0d20-4381-9682-4dac7a81d7ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:14 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume bd98d144-1fb7-4213-a887-3abc105da108: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd98d144-1fb7-4213-a887-3abc105da108', 'volume_size': 1} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3da3b608-6336-4fa6-bf24-7ac73f8fd977 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-61d4fa71-e5c2-4c14-a888-2774614c9b3b-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:14 devstack sudo[105657]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec" returned: 0 in 0.372s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] <== create_volume: return (1230ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.235s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.856s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1105859375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb941a1-73ef-424a-81a3-aad7f2a8b082,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:14Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Creating volume bcb941a1-73ef-424a-81a3-aad7f2a8b082 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:14 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5ad5af27-7f31-4ca8-b559-a8be8563f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:14 devstack sudo[105660]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 1073741824 Sep 03 12:10:14 devstack sudo[105660]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20080cd-1678-4d5c-b3e4-429bcb5ad805) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:14 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec (a6d85461-e3dc-4dad-bc4a-1f81515050ec): created successfully Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f20080cd-1678-4d5c-b3e4-429bcb5ad805) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:14 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (e4be5527-feed-4f3e-b712-5b1d8536ae1f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-56404f5e-d98a-4630-a9a4-98049ac4710e tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created volume successfully. Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (4e0b0fa8-3372-4eb8-b6ce-aeb106f2c99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952a6d3e-d489-489a-9bd4-b00981660f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "cinder-quobyte-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (952a6d3e-d489-489a-9bd4-b00981660f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676206746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dad2b9c-2c2b-448a-8dad-2490a3af932e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:15Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e62ec06-6146-4760-bc72-e4910d8ccf00) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e62ec06-6146-4760-bc72-e4910d8ccf00) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd4d0b7-2346-476d-ab1e-3274c94f0756) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (afd4d0b7-2346-476d-ab1e-3274c94f0756) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8dad2b9c-2c2b-448a-8dad-2490a3af932e', 'volume_name': 'volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9984a8-23b0-40f9-909d-a8caf6335227) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3e9984a8-23b0-40f9-909d-a8caf6335227) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9feaa7-6e8a-48fc-99ab-7eb9edb846c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume 8dad2b9c-2c2b-448a-8dad-2490a3af932e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e', 'volume_size': 1} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" acquired by "delete_volume" :: waited 0.064s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[23fccf24-2614-4827-b03b-f27a0d622d4c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:15 devstack sudo[105660]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 1073741824" returned: 0 in 0.587s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:15 devstack sudo[105669]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 Sep 03 12:10:15 devstack sudo[105669]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:15 devstack sudo[105668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b Sep 03 12:10:15 devstack sudo[105668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (00a0de6a-ce0a-4994-866b-1d4d7091d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ddb9a1-2746-45fd-8a61-c7e52f4935e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ddb9a1-2746-45fd-8a61-c7e52f4935e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-810794985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40773297-cc5a-4adc-a58c-d48b8b383b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:15Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bbbe68-bf07-40bc-bfb0-9b97da28ab25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3bbbe68-bf07-40bc-bfb0-9b97da28ab25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8192074-8347-4960-a0a8-e13325011b72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e8192074-8347-4960-a0a8-e13325011b72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40773297-cc5a-4adc-a58c-d48b8b383b7b', 'volume_name': 'volume-40773297-cc5a-4adc-a58c-d48b8b383b7b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d4d92a-76ec-4889-99b7-ad02e74a4695) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e9d4d92a-76ec-4889-99b7-ad02e74a4695) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a19854d-6c3f-4074-8fd1-bdb32feb6b7d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume 40773297-cc5a-4adc-a58c-d48b8b383b7b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40773297-cc5a-4adc-a58c-d48b8b383b7b', 'volume_size': 1} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:15 devstack sudo[105669]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] <== create_volume: return (910ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.914s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.200s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1860763010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd98d144-1fb7-4213-a887-3abc105da108,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:14Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Creating volume bd98d144-1fb7-4213-a887-3abc105da108 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:15 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51d93898-9989-4d6d-873f-e8fb6d9f28a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack sudo[105676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 1073741824 Sep 03 12:10:15 devstack sudo[105676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:15 devstack sudo[105668]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6424d460-53e8-4d1b-affe-8e2b429869f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" returned: 0 in 0.401s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 (bcb941a1-73ef-424a-81a3-aad7f2a8b082): created successfully Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6424d460-53e8-4d1b-affe-8e2b429869f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:15 devstack sudo[105678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b Sep 03 12:10:15 devstack sudo[105678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (6c0f690d-22cc-4d1e-a89c-4fe3e459f4ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-49ee92d8-3ecd-4e5f-a0f9-691dfce87d5d tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created volume successfully. Sep 03 12:10:15 devstack sudo[105678]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" returned: 0 in 0.263s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-quobyte-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b" released by "delete_volume" :: held 0.712s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Created reservations ['bb54d081-5f3a-4ddd-a83b-6c9486c12d67', '48e30fce-6a97-4eb5-ba11-e95bddcaeb82', 'da6c905e-a9bc-4222-bf32-91a683c2b493', 'be4a1c8a-7006-460e-9909-72dd6a99a065'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:16 devstack sudo[105685]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:16 devstack sudo[105685]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:16 devstack sudo[105676]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 1073741824" returned: 0 in 0.505s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:16 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:16 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:16 devstack sudo[105689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:16 devstack sudo[105689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:16 devstack sudo[105685]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.359s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Deleted volume successfully. Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a5d7dfcc-500f-4148-9b29-a7be0383fc16 tempest-VolumeDependencyTests-1771151447 None] Lock "cinder-6b83f347-ebe3-4cf1-bec5-aa2d6426d50b-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:16 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108" returned: 0 in 0.420s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] <== create_volume: return (979ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.982s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.441s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:16 devstack sudo[105689]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Creating offline snapshot ab17c30a-110d-4891-a5d3-336e702fe141 of volume c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.412s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97a57a6a-0d20-4381-9682-4dac7a81d7ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd98d144-1fb7-4213-a887-3abc105da108', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f0a15b-1f62-479e-a2b5-f356ad9dfd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bcb73a61-0c0a-4bc0-8360-e7e970dfbe02]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 29 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:10:16 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume volume-bd98d144-1fb7-4213-a887-3abc105da108 (bd98d144-1fb7-4213-a887-3abc105da108): created successfully Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (84f0a15b-1f62-479e-a2b5-f356ad9dfd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (579abcf1-1876-4e3c-82fd-5338ed742b86) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5b0986be-2776-4966-a222-605e70cc047f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created volume successfully. Sep 03 12:10:16 devstack sudo[105694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 Sep 03 12:10:16 devstack sudo[105694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:17 devstack sudo[105694]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797" returned: 0 in 0.450s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:17 devstack sudo[105700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 1G Sep 03 12:10:17 devstack sudo[105700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:17 devstack sudo[105700]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 1G" returned: 0 in 0.460s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:17 devstack sudo[105706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 Sep 03 12:10:17 devstack sudo[105706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:17 devstack sudo[105706]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141" returned: 0 in 0.299s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:17 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 is being set with open permissions: ugo+rw Sep 03 12:10:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:17 devstack sudo[105712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 Sep 03 12:10:17 devstack sudo[105712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:18 devstack sudo[105712]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141" returned: 0 in 0.284s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:18 devstack sudo[105715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.info Sep 03 12:10:18 devstack sudo[105715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:18 devstack sudo[105715]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.info" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:18 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.info is being set with open permissions: ugo+rw Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:18 devstack sudo[105718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.info Sep 03 12:10:18 devstack sudo[105718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:18 devstack sudo[105718]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.info" returned: 0 in 0.266s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.169s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.562s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1676206746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8dad2b9c-2c2b-448a-8dad-2490a3af932e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:15Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Creating volume 8dad2b9c-2c2b-448a-8dad-2490a3af932e {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:18 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:18 devstack sudo[105721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e 1073741824 Sep 03 12:10:18 devstack sudo[105721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f1b06688-580e-40a5-a408-2e0d266f71dc tempest-CreateVolumesFromSnapshotTest-1179562848 None] Create snapshot completed successfully Sep 03 12:10:19 devstack sudo[105721]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e 1073741824" returned: 0 in 0.572s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:19 devstack sudo[105727]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e Sep 03 12:10:19 devstack sudo[105727]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:19 devstack sudo[105727]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (a6aa7faf-08a7-4307-a1a6-e570efc7b96d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed79e049-53c1-4b5b-8315-7250cdb15598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] <== create_volume: return (946ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.267s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-810794985',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40773297-cc5a-4adc-a58c-d48b8b383b7b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='361d31293040411dab596836aa0c4643',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:15Z,use_quota=True,user_id='ef0379cbefac47e2954833cc130e068e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Creating volume 40773297-cc5a-4adc-a58c-d48b8b383b7b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:19 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed79e049-53c1-4b5b-8315-7250cdb15598) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045622476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e25cadd-c67c-4adc-b56c-2fcd8ea76e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:20Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f9dcb6-ecd4-4996-9872-7c13e5f64ec3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82f9dcb6-ecd4-4996-9872-7c13e5f64ec3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:19 devstack sudo[105730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b 1073741824 Sep 03 12:10:19 devstack sudo[105730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656504cb-ea1d-4160-850d-183604bb9bcf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (656504cb-ea1d-4160-850d-183604bb9bcf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e25cadd-c67c-4adc-b56c-2fcd8ea76e57', 'volume_name': 'volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d2eeb9-a264-4bc6-9860-7da653eb479c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f7d2eeb9-a264-4bc6-9860-7da653eb479c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dc9597-aedd-4196-85a1-84a67b186ef8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:19 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume 3e25cadd-c67c-4adc-b56c-2fcd8ea76e57: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57', 'volume_size': 1} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9b9feaa7-6e8a-48fc-99ab-7eb9edb846c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70dedf2-5fe7-4915-9cd5-7d5868ab86b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:19 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e (8dad2b9c-2c2b-448a-8dad-2490a3af932e): created successfully Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a70dedf2-5fe7-4915-9cd5-7d5868ab86b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:19 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (4e0b0fa8-3372-4eb8-b6ce-aeb106f2c99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:19 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-bacfaf37-6326-4670-b609-0413274e87b2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created volume successfully. Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (6df74b4c-68fd-4978-ac77-4f8c190b385a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2fbd2a-375e-4c58-8ec9-ad422445a55a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bd2fbd2a-375e-4c58-8ec9-ad422445a55a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245987601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dff39bd-5fff-48c2-8e9f-abd5a1598325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:20Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d97eb7-16bb-4069-b009-6c5497834685) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b7d97eb7-16bb-4069-b009-6c5497834685) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d798e8-2be9-428a-97d9-3ff1b0ec8fd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (04d798e8-2be9-428a-97d9-3ff1b0ec8fd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3dff39bd-5fff-48c2-8e9f-abd5a1598325', 'volume_name': 'volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b45c3ee-5820-4474-89fd-dd4bda185569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6b45c3ee-5820-4474-89fd-dd4bda185569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973d5373-e905-474b-ba79-7dbe1ae35cc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume 3dff39bd-5fff-48c2-8e9f-abd5a1598325: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325', 'volume_size': 1} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:20 devstack sudo[105730]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b 1073741824" returned: 0 in 0.734s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:20 devstack sudo[105736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b Sep 03 12:10:20 devstack sudo[105736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (5dacada8-201d-4d28-bee3-6dd295375b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7313f8c-2776-47bf-bf5f-d9ffab663157) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b7313f8c-2776-47bf-bf5f-d9ffab663157) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643718754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05afd87b-7b10-44d4-bf75-ebdd106c8bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:21Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2602f3-de74-4f25-9d9e-0800e0e2766e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc2602f3-de74-4f25-9d9e-0800e0e2766e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca2ca88-f277-45ec-8458-1039519f2de6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4ca2ca88-f277-45ec-8458-1039519f2de6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '05afd87b-7b10-44d4-bf75-ebdd106c8bfe', 'volume_name': 'volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06115423-b5c0-4851-9163-6eba2da4f080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (06115423-b5c0-4851-9163-6eba2da4f080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db912646-7587-4734-b7f7-23a893038a5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume 05afd87b-7b10-44d4-bf75-ebdd106c8bfe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe', 'volume_size': 1} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:20 devstack sudo[105736]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] <== create_volume: return (1110ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.028s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1045622476',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e25cadd-c67c-4adc-b56c-2fcd8ea76e57,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:20Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Creating volume 3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:20 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a19854d-6c3f-4074-8fd1-bdb32feb6b7d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40773297-cc5a-4adc-a58c-d48b8b383b7b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e68788-cece-4ab6-b044-7aa51152fa9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:20 devstack sudo[105739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 1073741824 Sep 03 12:10:20 devstack sudo[105739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:20 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Volume volume-40773297-cc5a-4adc-a58c-d48b8b383b7b (40773297-cc5a-4adc-a58c-d48b8b383b7b): created successfully Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1e68788-cece-4ab6-b044-7aa51152fa9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Flow 'volume_create_manager' (00a0de6a-ce0a-4994-866b-1d4d7091d97e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:21 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ecce9438-c1db-4c3a-9cac-8f8f141fac82 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created volume successfully. Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (812c178e-4439-40e2-a2d2-3dcbeb9d8f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526c34fd-5d11-4ee1-929f-e91a98c4636c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (526c34fd-5d11-4ee1-929f-e91a98c4636c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-275909551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbaef12-334b-4782-b3bc-f5dd3f73b82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:21Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92eb2dc-153d-4bd0-9f56-0b9e181c1c7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e92eb2dc-153d-4bd0-9f56-0b9e181c1c7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fa57ba-f7a5-4080-8132-cb0f95b7f657) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49fa57ba-f7a5-4080-8132-cb0f95b7f657) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbbaef12-334b-4782-b3bc-f5dd3f73b82b', 'volume_name': 'volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afadbf59-8fd6-494c-8dcc-104739da1ec9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (afadbf59-8fd6-494c-8dcc-104739da1ec9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888daea4-510a-485e-aebb-8edebda65a80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:21 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume dbbaef12-334b-4782-b3bc-f5dd3f73b82b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b', 'volume_size': 1} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-40773297-cc5a-4adc-a58c-d48b8b383b7b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-40773297-cc5a-4adc-a58c-d48b8b383b7b-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-quobyte-40773297-cc5a-4adc-a58c-d48b8b383b7b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-40773297-cc5a-4adc-a58c-d48b8b383b7b" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5edaca78-3943-49a6-84de-1c02115d2edb]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:21 devstack sudo[105739]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 1073741824" returned: 0 in 0.690s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:21 devstack sudo[105745]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 Sep 03 12:10:21 devstack sudo[105745]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:21 devstack sudo[105744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b Sep 03 12:10:21 devstack sudo[105744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (7d96cd30-7114-4ad5-9c60-3825d3e24081) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae292cfb-530d-4abe-996a-45554c9380a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae292cfb-530d-4abe-996a-45554c9380a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052064707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8219c99a-55fb-438d-b25b-4d0dac5ffc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:22Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:22 devstack sudo[105745]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad47a62-f40e-4cdf-a029-456d2aacc43c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad47a62-f40e-4cdf-a029-456d2aacc43c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9131171-3f73-44ef-9f8b-4b461878b935) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9131171-3f73-44ef-9f8b-4b461878b935) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8219c99a-55fb-438d-b25b-4d0dac5ffc3f', 'volume_name': 'volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7bd24c-ead9-40f8-a70f-2ef1ae504e40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db7bd24c-ead9-40f8-a70f-2ef1ae504e40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbe110c-bbbc-45e5-b814-999e3f993290) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:22 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume 8219c99a-55fb-438d-b25b-4d0dac5ffc3f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f', 'volume_size': 1} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57" returned: 0 in 0.419s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] <== create_volume: return (1187ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.191s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.775s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1245987601',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3dff39bd-5fff-48c2-8e9f-abd5a1598325,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:20Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Creating volume 3dff39bd-5fff-48c2-8e9f-abd5a1598325 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:22 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (89dc9597-aedd-4196-85a1-84a67b186ef8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e506479-948b-4e90-b115-fb3e0ba87d48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:22 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 1073741824 Sep 03 12:10:22 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:22 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 (3e25cadd-c67c-4adc-b56c-2fcd8ea76e57): created successfully Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6e506479-948b-4e90-b115-fb3e0ba87d48) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (a6aa7faf-08a7-4307-a1a6-e570efc7b96d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:22 devstack sudo[105744]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b" returned: 0 in 0.610s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b263b121-790c-4629-8576-b36144210f49 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created volume successfully. Sep 03 12:10:22 devstack sudo[105754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b Sep 03 12:10:22 devstack sudo[105754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:22 devstack sudo[105754]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-40773297-cc5a-4adc-a58c-d48b8b383b7b" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-40773297-cc5a-4adc-a58c-d48b8b383b7b" released by "delete_volume" :: held 0.999s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created reservations ['774cc968-03da-4663-9f83-08169d440971', '9696079f-41a0-4a49-b9eb-26edd516b08d', '5fd7d1c4-0472-4a33-98c1-ffd60cc3fcb2', '696eeb5c-1272-4529-9a48-c341da7ece22'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:22 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 1073741824" returned: 0 in 0.632s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:22 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:22 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:22 devstack sudo[105763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 Sep 03 12:10:22 devstack sudo[105763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:23 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Deleted volume successfully. Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a2ae288f-5c56-4b46-925e-336fda17610f tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-40773297-cc5a-4adc-a58c-d48b8b383b7b-delete_volume" released by "delete_volume" :: held 1.607s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:23 devstack sudo[105763]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325" returned: 0 in 0.402s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] <== create_volume: return (1104ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.107s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.422s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-643718754',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=05afd87b-7b10-44d4-bf75-ebdd106c8bfe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:21Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Creating volume 05afd87b-7b10-44d4-bf75-ebdd106c8bfe {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:23 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (973d5373-e905-474b-ba79-7dbe1ae35cc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:23 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe 1073741824 Sep 03 12:10:23 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc935ec-b506-4a41-8765-4dd88f1abb08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 (3dff39bd-5fff-48c2-8e9f-abd5a1598325): created successfully Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dc935ec-b506-4a41-8765-4dd88f1abb08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (6df74b4c-68fd-4978-ac77-4f8c190b385a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6bc90958-aa9b-45a9-b5f3-df43ea096342 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created volume successfully. Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-8dad2b9c-2c2b-448a-8dad-2490a3af932e-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-8dad2b9c-2c2b-448a-8dad-2490a3af932e-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:23 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe 1073741824" returned: 0 in 0.589s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-quobyte-8dad2b9c-2c2b-448a-8dad-2490a3af932e" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-8dad2b9c-2c2b-448a-8dad-2490a3af932e" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:23 devstack sudo[105774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe Sep 03 12:10:23 devstack sudo[105774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a1184d-86b2-437d-8b59-03f2aa475734]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:24 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e Sep 03 12:10:24 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:24 devstack sudo[105774]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe" returned: 0 in 0.293s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] <== create_volume: return (952ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.955s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.746s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-275909551',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbbaef12-334b-4782-b3bc-f5dd3f73b82b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:21Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Creating volume dbbaef12-334b-4782-b3bc-f5dd3f73b82b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:24 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:24 devstack sudo[105780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b 1073741824 Sep 03 12:10:24 devstack sudo[105780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (db912646-7587-4734-b7f7-23a893038a5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acce0cb-ce4c-40ec-bade-98fc9a48ae8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:24 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe (05afd87b-7b10-44d4-bf75-ebdd106c8bfe): created successfully Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4acce0cb-ce4c-40ec-bade-98fc9a48ae8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (5dacada8-201d-4d28-bee3-6dd295375b14) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:24 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7b0dcfe9-9a0c-4698-a204-93e600f3c7db tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created volume successfully. Sep 03 12:10:24 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e" returned: 0 in 0.555s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:24 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e Sep 03 12:10:24 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:24 devstack sudo[105780]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b 1073741824" returned: 0 in 0.567s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:24 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8dad2b9c-2c2b-448a-8dad-2490a3af932e" returned: 0 in 0.290s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-8dad2b9c-2c2b-448a-8dad-2490a3af932e" released by "delete_volume" :: held 0.914s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:24 devstack sudo[105793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b Sep 03 12:10:24 devstack sudo[105793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created reservations ['3435a4a5-8669-4e8c-b51c-8d2bb3974a8b', 'a8392a7a-dc05-40e4-bbc1-2e685f82d415', 'd541185b-0b26-4bce-bdb8-54d873ba8591', 'bae09b95-feca-4391-9775-a383d9917db3'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:25 devstack sudo[105795]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:25 devstack sudo[105795]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:25 devstack sudo[105793]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b" returned: 0 in 0.347s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.088s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1052064707',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8219c99a-55fb-438d-b25b-4d0dac5ffc3f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b65fea13dc6b4fba99bda7ace5d9550a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:22Z,use_quota=True,user_id='bb17b5f049d9459e989e369a6c41f3d9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Creating volume 8219c99a-55fb-438d-b25b-4d0dac5ffc3f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:25 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (888daea4-510a-485e-aebb-8edebda65a80) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:25 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f 1073741824 Sep 03 12:10:25 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf2d42e-caba-4baa-aeb7-9c2c53af672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:25 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b (dbbaef12-334b-4782-b3bc-f5dd3f73b82b): created successfully Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dbf2d42e-caba-4baa-aeb7-9c2c53af672f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (812c178e-4439-40e2-a2d2-3dcbeb9d8f1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:25 devstack sudo[105795]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.351s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Deleted volume successfully. Sep 03 12:10:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-386b358c-3983-42c0-a6e4-998433210455 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created volume successfully. Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6b9f4132-0882-4b96-9c5e-6c5578eefb4b tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-8dad2b9c-2c2b-448a-8dad-2490a3af932e-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:25 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f 1073741824" returned: 0 in 0.645s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:25 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f Sep 03 12:10:25 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-bd98d144-1fb7-4213-a887-3abc105da108-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-bd98d144-1fb7-4213-a887-3abc105da108-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-quobyte-bd98d144-1fb7-4213-a887-3abc105da108" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-bd98d144-1fb7-4213-a887-3abc105da108" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ca54bdd-d36f-4282-9860-07b303516d4e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:26 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f" returned: 0 in 0.347s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] <== create_volume: return (1041ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbbe110c-bbbc-45e5-b814-999e3f993290) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc78cc86-9c10-4b28-b0e3-938fe63b9e4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Volume volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f (8219c99a-55fb-438d-b25b-4d0dac5ffc3f): created successfully Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc78cc86-9c10-4b28-b0e3-938fe63b9e4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Flow 'volume_create_manager' (7d96cd30-7114-4ad5-9c60-3825d3e24081) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:26 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ca68095b-098c-4e1c-a72a-c0030d7693a8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created volume successfully. Sep 03 12:10:26 devstack sudo[105808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 Sep 03 12:10:26 devstack sudo[105808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:26 devstack sudo[105808]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108" returned: 0 in 0.485s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-8219c99a-55fb-438d-b25b-4d0dac5ffc3f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:26 devstack sudo[105814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108 Sep 03 12:10:26 devstack sudo[105814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-8219c99a-55fb-438d-b25b-4d0dac5ffc3f-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-8219c99a-55fb-438d-b25b-4d0dac5ffc3f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-8219c99a-55fb-438d-b25b-4d0dac5ffc3f" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[997ee2d9-0126-4aed-b079-235d46405d2d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Flow 'volume_create_manager' (ec5f5c63-94b7-49a8-b5a4-1c4276c0bc05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44f0996-d9a6-47a2-9808-38be85648b3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c44f0996-d9a6-47a2-9808-38be85648b3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880600329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232a88f1470945b79fa52c0ccfe68ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:27Z,use_quota=True,user_id='b42e366aeff74ef7aae4c0e0801eee9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c26557-c6d5-4375-8c6f-0fb03905b0a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (60c26557-c6d5-4375-8c6f-0fb03905b0a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:26 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f Sep 03 12:10:27 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f9a5c-43e5-40e7-af75-d192cfff5f8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:27 devstack sudo[105814]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (344f9a5c-43e5-40e7-af75-d192cfff5f8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11', 'volume_name': 'volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f8f7a-56f0-4fc2-9498-064df0b6d05d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8d4f8f7a-56f0-4fc2-9498-064df0b6d05d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb1ff58-bd61-4ab5-98e6-0562b0e99f35) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:27 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Volume 4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11', 'volume_size': 1} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-880600329',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232a88f1470945b79fa52c0ccfe68ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:27Z,use_quota=True,user_id='b42e366aeff74ef7aae4c0e0801eee9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Creating volume 4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:27 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bd98d144-1fb7-4213-a887-3abc105da108" returned: 0 in 0.365s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:27 devstack sudo[105819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 1073741824 Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-bd98d144-1fb7-4213-a887-3abc105da108" released by "delete_volume" :: held 0.908s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:27 devstack sudo[105819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created reservations ['aa5695ae-927a-4cca-98f8-024863eea6fb', 'eaa998fc-046c-4504-9698-d6efdc5bc064', '246c9ffc-0e3d-4126-97c5-d2fd95ae72b8', '12c5b396-78a9-40db-b2a3-2129fbae77fd'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:27 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:27 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-bcb941a1-73ef-424a-81a3-aad7f2a8b082-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-bcb941a1-73ef-424a-81a3-aad7f2a8b082-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-quobyte-bcb941a1-73ef-424a-81a3-aad7f2a8b082" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:27 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f" returned: 0 in 0.558s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-bcb941a1-73ef-424a-81a3-aad7f2a8b082" acquired by "delete_volume" :: waited 0.041s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fa9e0c1-bfa0-4604-af86-03178162a08b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:27 devstack sudo[105829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f Sep 03 12:10:27 devstack sudo[105829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:27 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.394s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:27 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Deleted volume successfully. Sep 03 12:10:27 devstack sudo[105832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 Sep 03 12:10:27 devstack sudo[105832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:27 devstack sudo[105819]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 1073741824" returned: 0 in 0.639s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e57134f7-a475-425f-9c1f-c3fbccd1ce67 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-bd98d144-1fb7-4213-a887-3abc105da108-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:27 devstack sudo[105835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 Sep 03 12:10:27 devstack sudo[105835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:27 devstack sudo[105829]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-8219c99a-55fb-438d-b25b-4d0dac5ffc3f" returned: 0 in 0.390s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-8219c99a-55fb-438d-b25b-4d0dac5ffc3f" released by "delete_volume" :: held 1.007s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created reservations ['1fdd8b20-81b3-4d4c-946f-bdbaa7787628', '5b7d097e-0aba-427a-a622-c599f8a81b69', '5774f9d0-5594-4e87-874c-082749cd4f8f', 'd0a4aeeb-8bda-420d-8fe8-180d5498dd22'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:27 devstack sudo[105832]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082" returned: 0 in 0.508s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:27 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:28 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082 Sep 03 12:10:28 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:28 devstack sudo[105835]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11" returned: 0 in 0.338s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] <== create_volume: return (1044ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.046s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:28 devstack sudo[105844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:28 devstack sudo[105844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ceb1ff58-bd61-4ab5-98e6-0562b0e99f35) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d297ea93-5774-4006-99b6-871826ad53e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:28 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Volume volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 (4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11): created successfully Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d297ea93-5774-4006-99b6-871826ad53e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Flow 'volume_create_manager' (ec5f5c63-94b7-49a8-b5a4-1c4276c0bc05) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-61d014bd-dcd0-4dd8-92f7-8012d47e235d tempest-ProjectReaderTests-501494595 None] Created volume successfully. Sep 03 12:10:28 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bcb941a1-73ef-424a-81a3-aad7f2a8b082" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-bcb941a1-73ef-424a-81a3-aad7f2a8b082" released by "delete_volume" :: held 0.855s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:28 devstack sudo[105844]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.273s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Deleted volume successfully. Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2eb62bd1-61ad-4241-906b-f0523760a472 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-8219c99a-55fb-438d-b25b-4d0dac5ffc3f-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created reservations ['b45fa913-0e95-485f-a110-139cfd1c5e99', '50ee5595-2473-46fb-a229-39ba45caf8e4', '23231e83-eb7b-4d29-ad17-dde79c497615', 'd9d37cad-ff79-4bbb-b977-e6a80a49fe8e'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:28 devstack sudo[105848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:28 devstack sudo[105848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-a6d85461-e3dc-4dad-bc4a-1f81515050ec-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-a6d85461-e3dc-4dad-bc4a-1f81515050ec-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-quobyte-a6d85461-e3dc-4dad-bc4a-1f81515050ec" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-a6d85461-e3dc-4dad-bc4a-1f81515050ec" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:28 devstack sudo[105848]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.283s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:28 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Deleted volume successfully. Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[80c57aab-1e63-48ee-bf21-92c741f5d2ee]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:28 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-88c906dc-0109-4ef7-890c-270f7b687107 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-bcb941a1-73ef-424a-81a3-aad7f2a8b082-delete_volume" released by "delete_volume" :: held 1.390s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:28 devstack sudo[105851]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec Sep 03 12:10:28 devstack sudo[105851]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-dbbaef12-334b-4782-b3bc-f5dd3f73b82b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-dbbaef12-334b-4782-b3bc-f5dd3f73b82b-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-dbbaef12-334b-4782-b3bc-f5dd3f73b82b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-dbbaef12-334b-4782-b3bc-f5dd3f73b82b" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[528536b2-f5b3-46ce-ba4e-e503ae3ba525]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Acquiring lock "cinder-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Lock "cinder-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:29 devstack sudo[105851]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec" returned: 0 in 0.595s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:29 devstack sudo[105856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b Sep 03 12:10:29 devstack sudo[105856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:29 devstack sudo[105858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Acquiring lock "cinder-quobyte-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:29 devstack sudo[105858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Lock "cinder-quobyte-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11" acquired by "delete_volume" :: waited 0.039s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bf33b2f6-38f6-4cad-9514-e5acedc00ce1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:29 devstack sudo[105860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 Sep 03 12:10:29 devstack sudo[105860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:29 devstack sudo[105856]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b" returned: 0 in 0.446s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:29 devstack sudo[105866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b Sep 03 12:10:29 devstack sudo[105866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:29 devstack sudo[105858]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a6d85461-e3dc-4dad-bc4a-1f81515050ec" returned: 0 in 0.409s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-a6d85461-e3dc-4dad-bc4a-1f81515050ec" released by "delete_volume" :: held 1.054s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created reservations ['db8dc129-007e-4df8-a0ba-baca485b3a85', 'ddefbf05-b904-4236-b219-2a3adcbd3efd', 'd832715b-a74c-49d4-8a62-5964dfbbc0fc', '3ad66ee3-1f0d-419f-a132-ae341d9e728c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:29 devstack sudo[105871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:29 devstack sudo[105860]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:29 devstack sudo[105871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11" returned: 0 in 0.482s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:29 devstack sudo[105874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11 Sep 03 12:10:29 devstack sudo[105874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:30 devstack sudo[105866]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-dbbaef12-334b-4782-b3bc-f5dd3f73b82b" returned: 0 in 0.361s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-dbbaef12-334b-4782-b3bc-f5dd3f73b82b" released by "delete_volume" :: held 0.858s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created reservations ['f200afa4-ad32-4886-9218-36211d6d9dcb', '09c9e2fb-25e3-47c2-9084-4349eff5d265', '9143ce89-d4ee-4a3e-985f-a9657b7dfbd8', 'f799d9f9-8097-4d43-841e-61f53787cac8'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:30 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:30 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:30 devstack sudo[105871]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-05afd87b-7b10-44d4-bf75-ebdd106c8bfe-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.410s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Deleted volume successfully. Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-05afd87b-7b10-44d4-bf75-ebdd106c8bfe-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b88f83df-6da2-43d3-97ff-b723c2b27cab tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-a6d85461-e3dc-4dad-bc4a-1f81515050ec-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:30 devstack sudo[105874]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11" returned: 0 in 0.440s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-05afd87b-7b10-44d4-bf75-ebdd106c8bfe" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Lock "cinder-quobyte-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11" released by "delete_volume" :: held 0.995s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-05afd87b-7b10-44d4-bf75-ebdd106c8bfe" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a559f07a-2d00-4e66-83a7-656cc3c7aeee]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:30 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:30 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Deleted volume successfully. Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Created reservations ['eafcca57-7c0e-49e6-88fa-41178e9126d5', '361acad3-a4cb-499d-b2f5-0073ead0bbf8', '5d4198f1-f043-4fa8-94b0-1822783fdb85', '592d7925-5fa1-41a8-a83e-de734f337d7d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8a20b411-fe69-4422-8e32-aeefb94474f2 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-dbbaef12-334b-4782-b3bc-f5dd3f73b82b-delete_volume" released by "delete_volume" :: held 1.554s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:30 devstack sudo[105915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe Sep 03 12:10:30 devstack sudo[105915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:30 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:30 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-61881f0c-6820-4da8-b037-33ee91d271f7-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-61881f0c-6820-4da8-b037-33ee91d271f7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:31 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.344s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Deleted volume successfully. Sep 03 12:10:31 devstack sudo[105915]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "cinder-quobyte-61881f0c-6820-4da8-b037-33ee91d271f7" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe" returned: 0 in 0.579s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-3afba3d0-dadd-438b-9151-78f9ef8f5e2b tempest-ProjectReaderTests-501494595 None] Lock "cinder-4ba7bd44-6b51-40aa-9046-7f3ca5a2ac11-delete_volume" released by "delete_volume" :: held 1.827s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-61881f0c-6820-4da8-b037-33ee91d271f7" acquired by "delete_volume" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:31 devstack sudo[105928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe Sep 03 12:10:31 devstack sudo[105928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[acf2b20a-5045-4572-a9a4-db231f05bc54]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:31 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 Sep 03 12:10:31 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:31 devstack sudo[105928]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-05afd87b-7b10-44d4-bf75-ebdd106c8bfe" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-05afd87b-7b10-44d4-bf75-ebdd106c8bfe" released by "delete_volume" :: held 0.943s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created reservations ['66a2dfc8-f819-4c63-be04-ffc960f89ac7', 'b5ce3a3f-51c1-4848-a358-27e87373b13c', 'a8462faf-462f-47ae-8323-6221a8108f69', 'bd5db103-1733-4cd7-8e18-928469852868'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:31 devstack sudo[105938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:31 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:31 devstack sudo[105938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7" returned: 0 in 0.438s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:31 devstack sudo[105940]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7 Sep 03 12:10:31 devstack sudo[105940]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:31 devstack sudo[105938]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.318s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Deleted volume successfully. Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6d9d5e22-89a1-4aee-9df7-621edc43b269 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-05afd87b-7b10-44d4-bf75-ebdd106c8bfe-delete_volume" released by "delete_volume" :: held 1.552s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:31 devstack sudo[105940]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-61881f0c-6820-4da8-b037-33ee91d271f7" returned: 0 in 0.322s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-quobyte-61881f0c-6820-4da8-b037-33ee91d271f7" released by "delete_volume" :: held 0.808s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Created reservations ['7f897810-ae05-43d9-a3d0-a262b2d84af1', '1947e439-22e7-4d5a-b56b-ca40c68973e5', '71a1b4d7-2c35-4b62-b92e-52248d5590e8', '209d97f2-13f7-42df-8e85-0912e8e88f05'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:32 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:32 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Flow 'volume_create_manager' (009785c0-d152-4ec0-afe1-29ed4e86b5e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5597e669-0255-40da-9360-799545007aff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5597e669-0255-40da-9360-799545007aff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114442965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d5cb61-626f-4501-867b-cb7c92d18161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232a88f1470945b79fa52c0ccfe68ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:32Z,use_quota=True,user_id='b42e366aeff74ef7aae4c0e0801eee9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb47414-1447-4d1b-ab5d-2c6f2489f00b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (edb47414-1447-4d1b-ab5d-2c6f2489f00b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5890c3f4-770b-4d63-ab78-288fed304b16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5890c3f4-770b-4d63-ab78-288fed304b16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd1d5cb61-626f-4501-867b-cb7c92d18161', 'volume_name': 'volume-d1d5cb61-626f-4501-867b-cb7c92d18161', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5510ef-85e7-4977-86cc-c5a9f4413640) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f5510ef-85e7-4977-86cc-c5a9f4413640) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:32 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73f026d-095f-49d3-a5cf-2ff7f6095407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:32 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Volume d1d5cb61-626f-4501-867b-cb7c92d18161: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d1d5cb61-626f-4501-867b-cb7c92d18161', 'volume_size': 1} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2114442965',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d1d5cb61-626f-4501-867b-cb7c92d18161,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='232a88f1470945b79fa52c0ccfe68ed0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:32Z,use_quota=True,user_id='b42e366aeff74ef7aae4c0e0801eee9e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Creating volume d1d5cb61-626f-4501-867b-cb7c92d18161 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:32 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.414s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Deleted volume successfully. Sep 03 12:10:32 devstack sudo[105949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 1073741824 Sep 03 12:10:32 devstack sudo[105949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b432ed47-281c-4cba-84b3-d5e7bd4befd2 tempest-CreateVolumesFromSourceVolumeTest-746847383 None] Lock "cinder-61881f0c-6820-4da8-b037-33ee91d271f7-delete_volume" released by "delete_volume" :: held 1.564s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-3dff39bd-5fff-48c2-8e9f-abd5a1598325-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-3dff39bd-5fff-48c2-8e9f-abd5a1598325-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-3dff39bd-5fff-48c2-8e9f-abd5a1598325" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-3dff39bd-5fff-48c2-8e9f-abd5a1598325" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa7c9688-ec0b-4331-bf45-b6b71433621e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:32 devstack sudo[105953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 Sep 03 12:10:32 devstack sudo[105953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:33 devstack sudo[105949]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 1073741824" returned: 0 in 0.630s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:33 devstack sudo[105958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 Sep 03 12:10:33 devstack sudo[105958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:33 devstack sudo[105953]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325" returned: 0 in 0.545s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:33 devstack sudo[105962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325 Sep 03 12:10:33 devstack sudo[105962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:33 devstack sudo[105958]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161" returned: 0 in 0.376s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] <== create_volume: return (1087ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e73f026d-095f-49d3-a5cf-2ff7f6095407) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d1d5cb61-626f-4501-867b-cb7c92d18161', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3228b1d-adb0-4859-888c-d2bf8f50243d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:33 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Volume volume-d1d5cb61-626f-4501-867b-cb7c92d18161 (d1d5cb61-626f-4501-867b-cb7c92d18161): created successfully Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3228b1d-adb0-4859-888c-d2bf8f50243d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Flow 'volume_create_manager' (009785c0-d152-4ec0-afe1-29ed4e86b5e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:33 devstack sudo[105962]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3dff39bd-5fff-48c2-8e9f-abd5a1598325" returned: 0 in 0.347s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3200abe2-32cf-48cc-a695-bd7b508d2315 tempest-ProjectReaderTests-501494595 None] Created volume successfully. Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-3dff39bd-5fff-48c2-8e9f-abd5a1598325" released by "delete_volume" :: held 0.944s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created reservations ['ed092099-1995-4afc-a26b-4af7795373e2', 'f37619f6-56fa-4bc3-ac4e-e5fdd6465374', '45a4aaf2-9afa-4cc6-9921-60c7c4be5e9c', 'e590aeea-3215-4405-b143-598559d7cafa'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:33 devstack sudo[105967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:33 devstack sudo[105967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:34 devstack sudo[105967]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Deleted volume successfully. Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2772189f-5ac0-49da-bd60-2fc6e5f86544 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-3dff39bd-5fff-48c2-8e9f-abd5a1598325-delete_volume" released by "delete_volume" :: held 1.566s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Acquiring lock "cinder-d1d5cb61-626f-4501-867b-cb7c92d18161-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Lock "cinder-d1d5cb61-626f-4501-867b-cb7c92d18161-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Acquiring lock "cinder-quobyte-d1d5cb61-626f-4501-867b-cb7c92d18161" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Lock "cinder-quobyte-d1d5cb61-626f-4501-867b-cb7c92d18161" acquired by "delete_volume" :: waited 0.037s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7055f6d-4b5c-4a53-b914-4e2cd776f77d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:34 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 Sep 03 12:10:34 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:35 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161" returned: 0 in 0.477s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:35 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161 Sep 03 12:10:35 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57" acquired by "delete_volume" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0b17df8-cc58-49ea-9a82-434d6ecfbdcc]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:35 devstack sudo[105978]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 Sep 03 12:10:35 devstack sudo[105978]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:35 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d1d5cb61-626f-4501-867b-cb7c92d18161" returned: 0 in 0.321s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Lock "cinder-quobyte-d1d5cb61-626f-4501-867b-cb7c92d18161" released by "delete_volume" :: held 0.859s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Created reservations ['e14ad746-55fc-4c83-831c-27c2a798877d', '4c0e1df3-4569-442f-8bad-f46482b84b28', '95deda39-18f9-4290-a03c-69af749ed340', '01e3b5e1-1b60-45b5-95ab-4faf4f5c0b6e'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:35 devstack sudo[105978]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57" returned: 0 in 0.451s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:35 devstack sudo[105984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:35 devstack sudo[105984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:35 devstack sudo[105986]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57 Sep 03 12:10:35 devstack sudo[105986]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:35 devstack sudo[105984]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Deleted volume successfully. Sep 03 12:10:35 devstack sudo[105986]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-20f08973-d663-4673-b6ff-2937ce2a0e73 tempest-ProjectReaderTests-501494595 None] Lock "cinder-d1d5cb61-626f-4501-867b-cb7c92d18161-delete_volume" released by "delete_volume" :: held 1.453s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57" returned: 0 in 0.300s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57" released by "delete_volume" :: held 0.810s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:35 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created reservations ['3b0e53df-8837-46fc-a268-293232662b90', 'efa2ad8d-bd8f-4107-b959-2122b94ff836', 'b3b25eec-f442-490a-ae9d-1b305cc2e659', '1f547d7e-c01a-4ba7-8c5f-4d65aca68c15'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:36 devstack sudo[105990]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:36 devstack sudo[105990]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-ab17c30a-110d-4891-a5d3-336e702fe141-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-ab17c30a-110d-4891-a5d3-336e702fe141-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-c5d75764-1d47-48ec-b4b9-3adf5e895797" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-c5d75764-1d47-48ec-b4b9-3adf5e895797" acquired by "delete_snapshot" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-ab17c30a-110d-4891-a5d3-336e702fe141" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-ab17c30a-110d-4891-a5d3-336e702fe141" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Deleting offline snapshot ab17c30a-110d-4891-a5d3-336e702fe141 of volume c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:10:36 devstack sudo[105990]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] snapshot_file for this snap is: volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Deleted volume successfully. Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b7b0cb6-a207-4342-85a9-a407ac5c9bb5]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ed1a8537-9b08-4c1f-b6bf-bf0264da7e43 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-3e25cadd-c67c-4adc-b56c-2fcd8ea76e57-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:36 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 Sep 03 12:10:36 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:36 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141" returned: 0 in 0.421s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c5d75764-1d47-48ec-b4b9-3adf5e895797(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2222250-5450-473f-a048-e2b78a2367d8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:36 devstack sudo[105998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 Sep 03 12:10:36 devstack sudo[105998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:37 devstack sudo[105998]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797" returned: 0 in 0.492s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:37 devstack sudo[106003]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 Sep 03 12:10:37 devstack sudo[106003]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:37 devstack sudo[106003]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141" returned: 0 in 0.485s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:37 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141 Sep 03 12:10:37 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:38 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797.ab17c30a-110d-4891-a5d3-336e702fe141" returned: 0 in 0.282s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-ab17c30a-110d-4891-a5d3-336e702fe141" released by "_delete_snapshot" :: held 1.825s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-c5d75764-1d47-48ec-b4b9-3adf5e895797" released by "delete_snapshot" :: held 1.860s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created reservations ['aac9e142-efe4-4b48-82ec-182088d32564', 'e6b49349-4932-420a-a2b4-3a299a20be38', '0a351756-55c1-43a5-a98c-45ca7fa277da', '05250682-382a-4741-b55d-b24721d311c9'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:38 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Delete snapshot completed successfully. Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-051d8867-7dd4-412d-b5e3-2d95a1d35dd8 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-ab17c30a-110d-4891-a5d3-336e702fe141-delete_snapshot" released by "delete_snapshot" :: held 2.021s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-c5d75764-1d47-48ec-b4b9-3adf5e895797-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-c5d75764-1d47-48ec-b4b9-3adf5e895797-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "cinder-quobyte-c5d75764-1d47-48ec-b4b9-3adf5e895797" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-c5d75764-1d47-48ec-b4b9-3adf5e895797" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e14a3bf5-1f75-4e9b-affe-c8655aef9884]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:38 devstack sudo[106012]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 Sep 03 12:10:38 devstack sudo[106012]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:39 devstack sudo[106012]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797" returned: 0 in 0.486s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:39 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797 Sep 03 12:10:39 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:39 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-c5d75764-1d47-48ec-b4b9-3adf5e895797" returned: 0 in 0.356s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-quobyte-c5d75764-1d47-48ec-b4b9-3adf5e895797" released by "delete_volume" :: held 0.947s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Created reservations ['35b63c7b-62f3-4cdd-a403-fba29d74b205', 'd8b1418e-96c9-49e4-81fb-951693b2cf0c', 'd9e388b2-0f64-4102-a20d-a0931ec4092c', 'd1721c84-f73f-47eb-a78c-a2f5a1696090'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:39 devstack sudo[106020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:39 devstack sudo[106020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Flow 'volume_create_manager' (e39c218c-4985-4bcd-822a-7ff201a68a7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731990d-fbd4-4dc6-a4d8-37000306a7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c731990d-fbd4-4dc6-a4d8-37000306a7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b87f560-0f0a-41fd-8e2d-ca37b78e47cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628cb60af39e4cc5bc4e1e1c2fa26ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:40Z,use_quota=True,user_id='0439f2abe3ee4b058450ae88c3de8aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e77200-861c-4f9b-8435-dc2438e6975f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e1e77200-861c-4f9b-8435-dc2438e6975f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3514540-710e-4b93-9c35-daeb70b16513) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:39 devstack cinder-volume[87256]: DEBUG cinder.image.glance [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Creating Keystone auth plugin from conf {{(pid=87256) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Sep 03 12:10:40 devstack sudo[106020]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.338s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:40 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Deleted volume successfully. Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-53b9e80d-3d57-4d2a-98a9-7dad29d76186 tempest-CreateVolumesFromSnapshotTest-1179562848 None] Lock "cinder-c5d75764-1d47-48ec-b4b9-3adf5e895797-delete_volume" released by "delete_volume" :: held 1.632s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e3514540-710e-4b93-9c35-daeb70b16513) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2b87f560-0f0a-41fd-8e2d-ca37b78e47cc', 'volume_name': 'volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc', 'volume_size': 1, 'image_id': 'cb451fba-2222-41dc-848c-40e34af1911c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb451fba-2222-41dc-848c-40e34af1911c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78450d0c663a07e390258b4500fe39f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '628cb60af39e4cc5bc4e1e1c2fa26ee4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36816894e0d31b1f5b9cd17143ad491b1b199b6711c454915c759abfaa4074d316281bf631ff63b4233c469e5e6f06035d73f6b661c695813bf91d62e303f814', 'id': 'cb451fba-2222-41dc-848c-40e34af1911c', 'created_at': datetime.datetime(2026, 9, 3, 10, 10, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 10, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb451fba-2222-41dc-848c-40e34af1911c/file', 'properties': {}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe09262-96fd-4941-99f1-8df693865457) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0fe09262-96fd-4941-99f1-8df693865457) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cecf77-3a7a-4ac9-ba81-c5f2167609d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:40 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Volume 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc', 'volume_size': 1, 'image_id': 'cb451fba-2222-41dc-848c-40e34af1911c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb451fba-2222-41dc-848c-40e34af1911c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78450d0c663a07e390258b4500fe39f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '628cb60af39e4cc5bc4e1e1c2fa26ee4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36816894e0d31b1f5b9cd17143ad491b1b199b6711c454915c759abfaa4074d316281bf631ff63b4233c469e5e6f06035d73f6b661c695813bf91d62e303f814', 'id': 'cb451fba-2222-41dc-848c-40e34af1911c', 'created_at': datetime.datetime(2026, 9, 3, 10, 10, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 10, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb451fba-2222-41dc-848c-40e34af1911c/file', 'properties': {}}, 'image_service': } Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Trying to clone 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc from image cb451fba-2222-41dc-848c-40e34af1911c at location (None, [{'url': 'file:///opt/stack/data/glance/images/cb451fba-2222-41dc-848c-40e34af1911c', 'metadata': {}}]). {{(pid=87256) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:735}} Sep 03 12:10:40 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Image download 0.00 MB at 0.00 MB/s Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8cf082-860f-463a-a430-eb138e5d48d3]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:40 devstack sudo[106023]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD Sep 03 12:10:40 devstack sudo[106023]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:41 devstack sudo[106023]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD" returned: 0 in 0.407s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:41 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD Sep 03 12:10:41 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (a11582a6-4dc2-4285-bdec-df4cbc42a50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf6be3e-be4e-4b69-b82f-2e47b9de31c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1cf6be3e-be4e-4b69-b82f-2e47b9de31c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988257952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:41Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083ac5a2-7968-4d87-a261-e56e0ef11f97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (083ac5a2-7968-4d87-a261-e56e0ef11f97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cdd01b-330f-413c-a4a2-1a1e4cab010b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (62cdd01b-330f-413c-a4a2-1a1e4cab010b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d', 'volume_name': 'volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2897911-eaf2-40b8-8d54-26571443b747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a2897911-eaf2-40b8-8d54-26571443b747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b665fc2d-f868-44ee-a1cd-97dc8fcba2b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:41 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Volume cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d', 'volume_size': 1} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-988257952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:41Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Creating volume cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:41 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:41 devstack sudo[106030]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD" returned: 1 in 0.453s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Temporary image cb451fba-2222-41dc-848c-40e34af1911c is fetched for user 0439f2abe3ee4b058450ae88c3de8aa1. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1434}} Sep 03 12:10:41 devstack sudo[106038]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d 1073741824 Sep 03 12:10:41 devstack sudo[106038]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[26cf41a5-7e04-4fb1-9065-82b5eec40f92]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:41 devstack sudo[106040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD Sep 03 12:10:41 devstack sudo[106040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:42 devstack sudo[106038]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d 1073741824" returned: 0 in 0.573s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:42 devstack sudo[106040]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD" returned: 0 in 0.482s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:42 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d Sep 03 12:10:42 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:42 devstack sudo[106047]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD Sep 03 12:10:42 devstack sudo[106047]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:42 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d" returned: 0 in 0.315s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] <== create_volume: return (980ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b665fc2d-f868-44ee-a1cd-97dc8fcba2b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc28a3bb-78bd-4a96-9e68-59c8fed50013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:42 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Volume volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d (cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d): created successfully Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc28a3bb-78bd-4a96-9e68-59c8fed50013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (a11582a6-4dc2-4285-bdec-df4cbc42a50b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:42 devstack sudo[106047]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD" returned: 1 in 0.429s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:39Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2b87f560-0f0a-41fd-8e2d-ca37b78e47cc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='628cb60af39e4cc5bc4e1e1c2fa26ee4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:40Z,use_quota=True,user_id='0439f2abe3ee4b058450ae88c3de8aa1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Creating volume 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:42 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:42 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-096dad13-3eda-45f7-aea4-85984be0e2d2 tempest-ProjectReaderTests-1062455854 None] Created volume successfully. Sep 03 12:10:42 devstack sudo[106055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc 1073741824 Sep 03 12:10:42 devstack sudo[106055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:43 devstack sudo[106055]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc 1073741824" returned: 0 in 0.527s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:43 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc Sep 03 12:10:43 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:43 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] <== create_volume: return (877ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.880s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Attempting download of cb451fba-2222-41dc-848c-40e34af1911c ((None, [{'url': 'file:///opt/stack/data/glance/images/cb451fba-2222-41dc-848c-40e34af1911c', 'metadata': {}}])) to volume 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1188}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ca5355e-4e20-462e-a0cc-9a0ab010c087]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb451fba-2222-41dc-848c-40e34af1911c_weicepww {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:43 devstack sudo[106064]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb451fba-2222-41dc-848c-40e34af1911c_weicepww Sep 03 12:10:43 devstack sudo[106064]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:43 devstack sudo[106064]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_cb451fba-2222-41dc-848c-40e34af1911c_weicepww" returned: 0 in 0.383s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb451fba-2222-41dc-848c-40e34af1911c_weicepww {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Lock "cinder-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:44 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb451fba-2222-41dc-848c-40e34af1911c_weicepww Sep 03 12:10:44 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-quobyte-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[46242c63-63b2-49ab-a3f1-c1f0ac0509ab]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:44 devstack sudo[106072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d Sep 03 12:10:44 devstack sudo[106072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:44 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb451fba-2222-41dc-848c-40e34af1911c_weicepww" returned: 1 in 0.447s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_cb451fba-2222-41dc-848c-40e34af1911c_weicepww' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2883a61a-1ba7-4a7a-8e8f-5d0ce48e1e39]: (4, 'raw') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:44 devstack sudo[106076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD Sep 03 12:10:44 devstack sudo[106076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:44 devstack sudo[106072]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d" returned: 0 in 0.413s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:44 devstack sudo[106081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d Sep 03 12:10:44 devstack sudo[106081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:44 devstack sudo[106076]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD" returned: 0 in 0.397s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:44 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD Sep 03 12:10:44 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:44 devstack sudo[106081]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d" returned: 0 in 0.343s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d" released by "delete_volume" :: held 0.818s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Created reservations ['6216769b-4227-412f-9668-71aa0c3a1786', '65ac21b7-f687-4006-a670-eca1a5473dea', 'f6620003-de86-4d9d-8e9d-54eab8c0c41e', '60bed6bd-84e0-4704-be0c-7b1d58740b66'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:45 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD" returned: 1 in 0.422s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD' failed. Not Retrying. {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] cb451fba-2222-41dc-848c-40e34af1911c was raw, converting to qcow2 {{(pid=87256) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1123}} Sep 03 12:10:45 devstack sudo[106091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:45 devstack sudo[106091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:45 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc Sep 03 12:10:45 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:45 devstack sudo[106091]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.405s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:45 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Deleted volume successfully. Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-da7d93a3-e7d3-4cd2-b96a-00550eab52bd tempest-ProjectReaderTests-1062455854 None] Lock "cinder-cc889660-ddd6-4d73-8d9f-b1fa1eac3b9d-delete_volume" released by "delete_volume" :: held 1.542s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:45 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc" returned: 0 in 0.635s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_cb451fba-2222-41dc-848c-40e34af1911c_iug5qc71devstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:10:45 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Converted 0.00 MB image at 0.00 MB/s Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:45 devstack sudo[106099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc 1G Sep 03 12:10:45 devstack sudo[106099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (447ea965-a837-47e8-9167-433dcaf2d53e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e5baa3-5e79-4291-82c7-67b85a2739d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72e5baa3-5e79-4291-82c7-67b85a2739d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244744530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f69341-d82a-40be-9fb0-30789b970fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:46Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387e7e5d-7106-4f23-b3a0-72c16550d3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (387e7e5d-7106-4f23-b3a0-72c16550d3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd64ce6e-f0e0-458d-9ce2-c9e879ab8376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dd64ce6e-f0e0-458d-9ce2-c9e879ab8376) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '51f69341-d82a-40be-9fb0-30789b970fa2', 'volume_name': 'volume-51f69341-d82a-40be-9fb0-30789b970fa2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a500d7-04ca-4179-83ee-17c929dd4a95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1a500d7-04ca-4179-83ee-17c929dd4a95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1363efdf-dc38-4b2b-8fb8-b48946516a47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Volume 51f69341-d82a-40be-9fb0-30789b970fa2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-51f69341-d82a-40be-9fb0-30789b970fa2', 'volume_size': 1} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1244744530',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=51f69341-d82a-40be-9fb0-30789b970fa2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:46Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Creating volume 51f69341-d82a-40be-9fb0-30789b970fa2 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:46 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 1073741824 Sep 03 12:10:46 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:46 devstack sudo[106099]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc 1G" returned: 0 in 0.480s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Downloaded image cb451fba-2222-41dc-848c-40e34af1911c ((None, [{'url': 'file:///opt/stack/data/glance/images/cb451fba-2222-41dc-848c-40e34af1911c', 'metadata': {}}])) to volume 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc successfully. {{(pid=87256) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1233}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Temporary image cb451fba-2222-41dc-848c-40e34af1911c for user 0439f2abe3ee4b058450ae88c3de8aa1 is deleted. {{(pid=87256) fetch /opt/stack/cinder/cinder/image/image_utils.py:1438}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.volume_utils [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Marking volume 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc as bootable. {{(pid=87256) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1137}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Copying metadata from image cb451fba-2222-41dc-848c-40e34af1911c to 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc. {{(pid=87256) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Creating volume glance metadata for volume 2b87f560-0f0a-41fd-8e2d-ca37b78e47cc backed by image cb451fba-2222-41dc-848c-40e34af1911c with: {'image_id': 'cb451fba-2222-41dc-848c-40e34af1911c', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '78450d0c663a07e390258b4500fe39f2', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=87256) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41cecf77-3a7a-4ac9-ba81-c5f2167609d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc', 'volume_size': 1, 'image_id': 'cb451fba-2222-41dc-848c-40e34af1911c', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/cb451fba-2222-41dc-848c-40e34af1911c', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '78450d0c663a07e390258b4500fe39f2', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '628cb60af39e4cc5bc4e1e1c2fa26ee4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '36816894e0d31b1f5b9cd17143ad491b1b199b6711c454915c759abfaa4074d316281bf631ff63b4233c469e5e6f06035d73f6b661c695813bf91d62e303f814', 'id': 'cb451fba-2222-41dc-848c-40e34af1911c', 'created_at': datetime.datetime(2026, 9, 3, 10, 10, 37, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 9, 3, 10, 10, 39, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/cb451fba-2222-41dc-848c-40e34af1911c/file', 'properties': {}}, 'image_service': }' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825a36c5-f9ba-4685-a52c-de3f57816ca3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Volume volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc (2b87f560-0f0a-41fd-8e2d-ca37b78e47cc): created successfully Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (825a36c5-f9ba-4685-a52c-de3f57816ca3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Flow 'volume_create_manager' (e39c218c-4985-4bcd-822a-7ff201a68a7e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a075344b-86f4-4b01-9ae2-2f30faf8413f tempest-VolumeImageDependencyTests-1853516632 None] Created volume successfully. Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (aee3d41f-358f-43fd-90dc-ce76a1bf2c37) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba49f42-7213-4b66-bf3d-a80e4dd4da97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aba49f42-7213-4b66-bf3d-a80e4dd4da97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-656743042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaa0844-dde5-4648-bb7e-ca72fa40fab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:46Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733f767f-453d-4193-8446-887c9df7be90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (733f767f-453d-4193-8446-887c9df7be90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bb4374-df3f-49eb-99fd-d41ba0ca3679) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e2bb4374-df3f-49eb-99fd-d41ba0ca3679) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eaaa0844-dde5-4648-bb7e-ca72fa40fab4', 'volume_name': 'volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3ae3f3-7cf8-4cc4-81ec-f689c8875885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2e3ae3f3-7cf8-4cc4-81ec-f689c8875885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd46686-f6c8-4772-a9bb-9d532013bbb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Volume eaaa0844-dde5-4648-bb7e-ca72fa40fab4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4', 'volume_size': 1} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:46 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 1073741824" returned: 0 in 0.579s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:46 devstack sudo[106110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 Sep 03 12:10:46 devstack sudo[106110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:46 devstack sudo[106110]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2" returned: 0 in 0.258s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.882s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.339s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-656743042',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eaaa0844-dde5-4648-bb7e-ca72fa40fab4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:46Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Creating volume eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1363efdf-dc38-4b2b-8fb8-b48946516a47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-51f69341-d82a-40be-9fb0-30789b970fa2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54340880-c8a2-4b3c-9f26-5e1d35bdde73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:46 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 1073741824 Sep 03 12:10:46 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Volume volume-51f69341-d82a-40be-9fb0-30789b970fa2 (51f69341-d82a-40be-9fb0-30789b970fa2): created successfully Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (54340880-c8a2-4b3c-9f26-5e1d35bdde73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (447ea965-a837-47e8-9167-433dcaf2d53e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-70a46446-71c2-4997-bcd7-13723b4bd5e2 tempest-ProjectReaderTests-1062455854 None] Created volume successfully. Sep 03 12:10:47 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 1073741824" returned: 0 in 0.491s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:47 devstack sudo[106119]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 Sep 03 12:10:47 devstack sudo[106119]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Acquiring lock "cinder-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Lock "cinder-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Acquiring lock "cinder-quobyte-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Lock "cinder-quobyte-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bdb19446-2862-4fc9-908d-f6a505a25112]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:47 devstack sudo[106119]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] <== create_volume: return (816ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.818s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fcd46686-f6c8-4772-a9bb-9d532013bbb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d95cc66-4750-4a03-93fe-e3096f95d7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:47 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc Sep 03 12:10:47 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:47 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Volume volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 (eaaa0844-dde5-4648-bb7e-ca72fa40fab4): created successfully Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d95cc66-4750-4a03-93fe-e3096f95d7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:47 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (aee3d41f-358f-43fd-90dc-ce76a1bf2c37) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:47 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-3e0d9a11-91a7-4aa4-9c83-f9ce60631fa9 tempest-ProjectReaderTests-936188469 None] Created volume successfully. Sep 03 12:10:48 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc" returned: 0 in 0.362s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:48 devstack sudo[106128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc Sep 03 12:10:48 devstack sudo[106128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-51f69341-d82a-40be-9fb0-30789b970fa2-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-51f69341-d82a-40be-9fb0-30789b970fa2-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=244,cinder:UPDATE=297,cinder:DELETE=29,cinder:INSERT=78 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-quobyte-51f69341-d82a-40be-9fb0-30789b970fa2" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-51f69341-d82a-40be-9fb0-30789b970fa2" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:48 devstack sudo[106128]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc" returned: 0 in 0.319s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[648d69cb-a1de-4b90-ac66-1e962fbcf742]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Lock "cinder-quobyte-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc" released by "delete_volume" :: held 0.738s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=205,cinder:UPDATE=322,cinder:INSERT=84,cinder:DELETE=27 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Created reservations ['2262dae7-8bc9-474b-bd60-8a0eb545e23b', '3d718d20-913f-42c6-be71-8c8da9bc9669', '2381a135-d2d8-45c2-a54e-f3c63d68f203', '7330b8f8-c4ac-47f1-bd3f-8d3a8e3df822'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:48 devstack sudo[106131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 Sep 03 12:10:48 devstack sudo[106131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:48 devstack sudo[106133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:48 devstack sudo[106133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Creating offline snapshot 6fef092d-350d-4575-b68a-0d280bd2c21e of volume eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[217fecf9-f6af-4930-963a-56f18a30804c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:48 devstack sudo[106131]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2" returned: 0 in 0.589s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:48 devstack sudo[106133]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.386s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:48 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:48 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Deleted volume successfully. Sep 03 12:10:48 devstack sudo[106140]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2 Sep 03 12:10:48 devstack sudo[106140]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-597a64f9-6208-4d99-a36a-9bd4a1ee5422 tempest-VolumeImageDependencyTests-1853516632 None] Lock "cinder-2b87f560-0f0a-41fd-8e2d-ca37b78e47cc-delete_volume" released by "delete_volume" :: held 1.451s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:49 devstack sudo[106138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 Sep 03 12:10:49 devstack sudo[106138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:49 devstack sudo[106140]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-51f69341-d82a-40be-9fb0-30789b970fa2" returned: 0 in 0.301s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-51f69341-d82a-40be-9fb0-30789b970fa2" released by "delete_volume" :: held 0.965s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Created reservations ['a0792afa-ae16-4564-b602-df3260ba35f3', 'a62c5c35-4499-4981-9217-38f14acacbc4', 'e2a5cd47-a961-4610-a13a-1bb1cda93056', 'cdaa8afb-c29e-4b18-871d-987dc964796d'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:49 devstack sudo[106138]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" returned: 0 in 0.538s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:49 devstack sudo[106148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e 1G Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:49 devstack sudo[106148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:49 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:49 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:49 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.284s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:49 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Deleted volume successfully. Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-c73d996d-8078-4158-a651-4f0c3d67d9c1 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-51f69341-d82a-40be-9fb0-30789b970fa2-delete_volume" released by "delete_volume" :: held 1.562s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:49 devstack sudo[106148]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e 1G" returned: 0 in 0.464s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:49 devstack sudo[106157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e Sep 03 12:10:49 devstack sudo[106157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:50 devstack sudo[106157]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e" returned: 0 in 0.357s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:50 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e is being set with open permissions: ugo+rw Sep 03 12:10:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:50 devstack sudo[106163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e Sep 03 12:10:50 devstack sudo[106163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:50 devstack sudo[106163]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e" returned: 0 in 0.303s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:50 devstack sudo[106166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.info Sep 03 12:10:50 devstack sudo[106166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:50 devstack sudo[106166]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.info" returned: 0 in 0.371s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:50 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.info is being set with open permissions: ugo+rw Sep 03 12:10:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:50 devstack sudo[106169]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.info Sep 03 12:10:50 devstack sudo[106169]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (6c304947-fced-43de-94da-0da6d8b34b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8431ccb4-0ddd-4ef2-a89a-0704972d7326) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8431ccb4-0ddd-4ef2-a89a-0704972d7326) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756322616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c62cca6-fe15-4736-a492-7c92182814a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:51Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8086d-4339-4e07-acd3-3e9e3a4476ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1a8086d-4339-4e07-acd3-3e9e3a4476ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feefc4a-a0d7-42c4-803e-0d1db3428061) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4feefc4a-a0d7-42c4-803e-0d1db3428061) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c62cca6-fe15-4736-a492-7c92182814a2', 'volume_name': 'volume-5c62cca6-fe15-4736-a492-7c92182814a2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcba847-1ce1-4e04-a649-daab9d3e660b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dcba847-1ce1-4e04-a649-daab9d3e660b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e758072-8653-4840-a337-73fd69fa6c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:51 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Volume 5c62cca6-fe15-4736-a492-7c92182814a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c62cca6-fe15-4736-a492-7c92182814a2', 'volume_size': 1} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:51 devstack sudo[106169]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.info" returned: 0 in 0.342s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.508s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.108s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-756322616',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c62cca6-fe15-4736-a492-7c92182814a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:51Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Creating volume 5c62cca6-fe15-4736-a492-7c92182814a2 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:51 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:51 devstack sudo[106172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 1073741824 Sep 03 12:10:51 devstack sudo[106172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-df7a1cf1-9e64-480e-aac2-fab63f90a386 tempest-ProjectReaderTests-936188469 None] Create snapshot completed successfully Sep 03 12:10:51 devstack sudo[106172]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 1073741824" returned: 0 in 0.510s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:51 devstack sudo[106178]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 Sep 03 12:10:51 devstack sudo[106178]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:52 devstack sudo[106178]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2" returned: 0 in 0.324s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e758072-8653-4840-a337-73fd69fa6c84) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c62cca6-fe15-4736-a492-7c92182814a2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21b82a-1715-4412-a373-fc1bc04a655d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:52 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Volume volume-5c62cca6-fe15-4736-a492-7c92182814a2 (5c62cca6-fe15-4736-a492-7c92182814a2): created successfully Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8a21b82a-1715-4412-a373-fc1bc04a655d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (6c304947-fced-43de-94da-0da6d8b34b02) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2f6cb563-7864-483f-ac9e-f275bb1661d8 tempest-ProjectReaderTests-1062455854 None] Created volume successfully. Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-6fef092d-350d-4575-b68a-0d280bd2c21e-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Lock "cinder-6fef092d-350d-4575-b68a-0d280bd2c21e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-6fef092d-350d-4575-b68a-0d280bd2c21e" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-6fef092d-350d-4575-b68a-0d280bd2c21e" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Deleting offline snapshot 6fef092d-350d-4575-b68a-0d280bd2c21e of volume eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] snapshot_file for this snap is: volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf32942-ae77-4066-80df-126ff6a4ad44]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:52 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e Sep 03 12:10:52 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:52 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e" returned: 0 in 0.379s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ed5be1-e308-4635-8795-b9b035ed2f5f]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:53 devstack sudo[106187]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 Sep 03 12:10:53 devstack sudo[106187]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-3984703b-e7cb-4420-9f88-7af3fe10bb04 tempest-ProjectAdminTests-1661803969 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.850830078125, 'free_capacity_gb': 1773.850830078125, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=87256) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-5c62cca6-fe15-4736-a492-7c92182814a2-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:53 devstack sudo[106187]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" returned: 0 in 0.445s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-5c62cca6-fe15-4736-a492-7c92182814a2-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:53 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e Sep 03 12:10:53 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-quobyte-5c62cca6-fe15-4736-a492-7c92182814a2" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-5c62cca6-fe15-4736-a492-7c92182814a2" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[019b7314-fb09-4ff8-ab43-71945088da23]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:53 devstack sudo[106195]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 Sep 03 12:10:53 devstack sudo[106195]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:53 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e" returned: 0 in 0.532s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:53 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e Sep 03 12:10:53 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:53 devstack sudo[106195]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2" returned: 0 in 0.450s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:54 devstack sudo[106206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2 Sep 03 12:10:54 devstack sudo[106206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:54 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4.6fef092d-350d-4575-b68a-0d280bd2c21e" returned: 0 in 0.290s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-6fef092d-350d-4575-b68a-0d280bd2c21e" released by "_delete_snapshot" :: held 1.756s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" released by "delete_snapshot" :: held 1.788s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:54 devstack sudo[106206]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5c62cca6-fe15-4736-a492-7c92182814a2" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-5c62cca6-fe15-4736-a492-7c92182814a2" released by "delete_volume" :: held 0.826s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Created reservations ['600f27a2-578e-4018-9336-2fc15ac09c62', 'b526c573-2720-4e66-b60d-5105504f482a', '3ecab465-6ce4-4efd-953e-b5c0dcec83f2', 'ad8bcf61-1dff-4f4e-a307-83ef61b5cce6'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Created reservations ['7ad13c0f-2748-467a-8a1f-d6c9ff68f7ce', '1ff7f9ac-3c01-45b1-940d-7b2770463841', 'c26f0cc7-a61a-43e1-8e26-b5e293b3cbd0', '366cf865-8640-43bf-81a4-6789c14613a6'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Delete snapshot completed successfully. Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1f8a7462-500d-45dc-929a-1482d162af03 tempest-ProjectReaderTests-936188469 None] Lock "cinder-6fef092d-350d-4575-b68a-0d280bd2c21e-delete_snapshot" released by "delete_snapshot" :: held 2.092s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-eaaa0844-dde5-4648-bb7e-ca72fa40fab4-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:54 devstack sudo[106210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:54 devstack sudo[106210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Lock "cinder-eaaa0844-dde5-4648-bb7e-ca72fa40fab4-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2452f679-b484-41ec-bf44-ca594b4237e7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:55 devstack sudo[106212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 Sep 03 12:10:55 devstack sudo[106212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:55 devstack sudo[106210]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.525s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:55 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Deleted volume successfully. Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-a9c7520f-369f-4b88-aae6-9c8116bf8e96 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-5c62cca6-fe15-4736-a492-7c92182814a2-delete_volume" released by "delete_volume" :: held 1.760s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (31e3cd0b-c342-47a4-8f83-c6a4e4789919) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580c8e57-3269-442c-855c-93390c60b9ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:55 devstack sudo[106212]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" returned: 0 in 0.565s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (580c8e57-3269-442c-855c-93390c60b9ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200131631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d459c9-a290-4adf-a796-6d891659739b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:55Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:55 devstack sudo[106218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4 Sep 03 12:10:55 devstack sudo[106218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c3d7f7-2213-41b0-ba9b-2c861b6c20b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34c3d7f7-2213-41b0-ba9b-2c861b6c20b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa15fc2f-9631-406a-b378-a0fe8e2c2070) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa15fc2f-9631-406a-b378-a0fe8e2c2070) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd2d459c9-a290-4adf-a796-6d891659739b', 'volume_name': 'volume-d2d459c9-a290-4adf-a796-6d891659739b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e2c1d-a709-48ad-bc39-efa45ac400bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4b2e2c1d-a709-48ad-bc39-efa45ac400bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c88d2c8-6504-4357-8fc6-eac138cf12c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:55 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Volume d2d459c9-a290-4adf-a796-6d891659739b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d2d459c9-a290-4adf-a796-6d891659739b', 'volume_size': 1} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1200131631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d2d459c9-a290-4adf-a796-6d891659739b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='29e7c5fea76d41aa9660c1e9870a87a9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:55Z,use_quota=True,user_id='94da819b7673463bb72e57a99b7dddf6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Creating volume d2d459c9-a290-4adf-a796-6d891659739b {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:55 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:55 devstack sudo[106220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b 1073741824 Sep 03 12:10:55 devstack sudo[106220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:55 devstack sudo[106218]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" returned: 0 in 0.337s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-eaaa0844-dde5-4648-bb7e-ca72fa40fab4" released by "delete_volume" :: held 1.005s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Created reservations ['dc8b13b2-aace-4a50-a39e-c9d0defa1d06', '328a4852-9ec3-4f9c-bf72-d6cf695d7176', '1d3e0864-3cc6-4db0-a606-9b65a4dfd832', 'b135976a-1a88-40c1-aca0-5c38cdedc3c7'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:55 devstack sudo[106226]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:55 devstack sudo[106226]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:56 devstack sudo[106220]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b 1073741824" returned: 0 in 0.590s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:56 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b Sep 03 12:10:56 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:56 devstack sudo[106226]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.335s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:56 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Deleted volume successfully. Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-e1520d77-b38f-4120-91bd-59917125de77 tempest-ProjectReaderTests-936188469 None] Lock "cinder-eaaa0844-dde5-4648-bb7e-ca72fa40fab4-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:56 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b" returned: 0 in 0.316s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] <== create_volume: return (981ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c88d2c8-6504-4357-8fc6-eac138cf12c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d2d459c9-a290-4adf-a796-6d891659739b', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc8ff88-9306-4389-ab11-a93e4a4a6ee3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:56 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Volume volume-d2d459c9-a290-4adf-a796-6d891659739b (d2d459c9-a290-4adf-a796-6d891659739b): created successfully Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fdc8ff88-9306-4389-ab11-a93e4a4a6ee3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:56 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Flow 'volume_create_manager' (31e3cd0b-c342-47a4-8f83-c6a4e4789919) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:56 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8021ec2d-afd1-4eea-9f12-7b79ee3fd8b9 tempest-ProjectReaderTests-1062455854 None] Created volume successfully. Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-d2d459c9-a290-4adf-a796-6d891659739b-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-d2d459c9-a290-4adf-a796-6d891659739b-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "cinder-quobyte-d2d459c9-a290-4adf-a796-6d891659739b" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-d2d459c9-a290-4adf-a796-6d891659739b" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[4cc1a1bc-42de-4542-8ec7-62cb6f5f3403]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (c8b935e9-f8c3-49ca-a071-cfda3b640e94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5e2153-70d1-4083-aff7-a86496f2ac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c5e2153-70d1-4083-aff7-a86496f2ac3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922020001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126d4d33-911e-4856-9328-2013623847ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:58Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39520778-7f6f-4152-9254-1e3c5514056c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39520778-7f6f-4152-9254-1e3c5514056c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ea9463-7304-460f-936d-29de2a360284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:57 devstack sudo[106232]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b Sep 03 12:10:57 devstack sudo[106232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a8ea9463-7304-460f-936d-29de2a360284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '126d4d33-911e-4856-9328-2013623847ad', 'volume_name': 'volume-126d4d33-911e-4856-9328-2013623847ad', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128fb1bb-18c7-4825-9fae-20f5e9efd4b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (128fb1bb-18c7-4825-9fae-20f5e9efd4b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8565dceb-8709-4ca5-b746-8e086c9f4187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:57 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Volume 126d4d33-911e-4856-9328-2013623847ad: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-126d4d33-911e-4856-9328-2013623847ad', 'volume_size': 1} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-922020001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=126d4d33-911e-4856-9328-2013623847ad,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:58Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Creating volume 126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:57 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:57 devstack sudo[106234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad 1073741824 Sep 03 12:10:57 devstack sudo[106234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:58 devstack sudo[106232]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b" returned: 0 in 0.472s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:58 devstack sudo[106241]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b Sep 03 12:10:58 devstack sudo[106241]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:58 devstack sudo[106241]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:58 devstack sudo[106234]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad 1073741824" returned: 0 in 0.613s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d2d459c9-a290-4adf-a796-6d891659739b" returned: 0 in 0.330s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-quobyte-d2d459c9-a290-4adf-a796-6d891659739b" released by "delete_volume" :: held 0.875s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:58 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad Sep 03 12:10:58 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Created reservations ['ad2a4352-9844-4573-aca7-a166a9e54fc1', '07f81e56-4073-4285-9550-55c5e2fd42ea', '8894789c-8f1c-4135-a662-49aed07a6382', '8526381f-d0d3-4ef0-91c8-a2c2579f04eb'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (62a2127d-4c57-40ce-99df-41e2dd10ebae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104be3f4-f758-49dd-a990-536965bae158) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (104be3f4-f758-49dd-a990-536965bae158) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779385165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd8bbe6-1334-45fa-8563-b35d4a6be398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:59Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82184d23-50e8-4f36-9c7c-29d841e1b82f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82184d23-50e8-4f36-9c7c-29d841e1b82f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0d54cc-9330-4dbb-8e08-f2df295d4612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c0d54cc-9330-4dbb-8e08-f2df295d4612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfd8bbe6-1334-45fa-8563-b35d4a6be398', 'volume_name': 'volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e9fbae-043b-4592-a8b3-edde577e75f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91e9fbae-043b-4592-a8b3-edde577e75f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dce7d8-e3e6-42fe-b1cc-0613801a8a3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:58 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Volume bfd8bbe6-1334-45fa-8563-b35d4a6be398: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398', 'volume_size': 1} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:58 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:10:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-779385165',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfd8bbe6-1334-45fa-8563-b35d4a6be398,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:10:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:10:59Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Creating volume bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:10:58 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:58 devstack sudo[106249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 1073741824 Sep 03 12:10:58 devstack sudo[106249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8565dceb-8709-4ca5-b746-8e086c9f4187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-126d4d33-911e-4856-9328-2013623847ad', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a911d9be-85b9-4a2a-8a5e-588038c42be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:58 devstack sudo[106250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:10:58 devstack sudo[106250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:58 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Volume volume-126d4d33-911e-4856-9328-2013623847ad (126d4d33-911e-4856-9328-2013623847ad): created successfully Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a911d9be-85b9-4a2a-8a5e-588038c42be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:58 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (c8b935e9-f8c3-49ca-a071-cfda3b640e94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:58 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f871c88c-cedb-499a-be30-72969fda8ee8 tempest-ProjectReaderTests-936188469 None] Created volume successfully. Sep 03 12:10:59 devstack sudo[106250]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.345s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:10:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Deleted volume successfully. Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7b2dc3d4-228b-4d63-a594-6b1e94338ea9 tempest-ProjectReaderTests-1062455854 None] Lock "cinder-d2d459c9-a290-4adf-a796-6d891659739b-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:10:59 devstack sudo[106249]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 1073741824" returned: 0 in 0.599s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:10:59 devstack sudo[106258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 Sep 03 12:10:59 devstack sudo[106258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:10:59 devstack sudo[106258]: pam_unix(sudo:session): session closed for user root Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398" returned: 0 in 0.439s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] <== create_volume: return (1084ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.087s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c2dce7d8-e3e6-42fe-b1cc-0613801a8a3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e7654a-54a0-4df1-a277-e2e03632a94c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:10:59 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Volume volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 (bfd8bbe6-1334-45fa-8563-b35d4a6be398): created successfully Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d9e7654a-54a0-4df1-a277-e2e03632a94c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (62a2127d-4c57-40ce-99df-41e2dd10ebae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:10:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fd48ea6d-ba9b-43e7-a78d-301f2fec9d51 tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Creating offline snapshot 3061b730-aac7-47c6-9b0f-3cdbbea5ba1b of volume 126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[61770e3b-a8be-40c6-b292-943da51166a5]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:10:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:00 devstack sudo[106261]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad Sep 03 12:11:00 devstack sudo[106261]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:00 devstack sudo[106261]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad" returned: 0 in 0.452s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:00 devstack sudo[106266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b 1G Sep 03 12:11:00 devstack sudo[106266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:01 devstack sudo[106266]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b 1G" returned: 0 in 0.699s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-126d4d33-911e-4856-9328-2013623847ad -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:01 devstack sudo[106272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-126d4d33-911e-4856-9328-2013623847ad -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b Sep 03 12:11:01 devstack sudo[106272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:01 devstack sudo[106272]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-126d4d33-911e-4856-9328-2013623847ad -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" returned: 0 in 0.377s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:01 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b is being set with open permissions: ugo+rw Sep 03 12:11:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:01 devstack sudo[106277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b Sep 03 12:11:01 devstack sudo[106277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:01 devstack sudo[106277]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" returned: 0 in 0.246s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:01 devstack sudo[106280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.info Sep 03 12:11:01 devstack sudo[106280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:02 devstack sudo[106280]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.info" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:02 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.info is being set with open permissions: ugo+rw Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:02 devstack sudo[106283]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.info Sep 03 12:11:02 devstack sudo[106283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:02 devstack sudo[106283]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.info" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.447s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.086s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Creating offline snapshot ea110ab4-37ab-4470-a880-896996cadfaa of volume bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[80743e9b-52df-4d0a-a800-490dafb20155]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-95900183-7149-46ca-b8b8-0ece2995efba tempest-ProjectReaderTests-936188469 None] Create snapshot completed successfully Sep 03 12:11:02 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 Sep 03 12:11:02 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:02 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398" returned: 0 in 0.376s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:02 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa 1G Sep 03 12:11:02 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-3061b730-aac7-47c6-9b0f-3cdbbea5ba1b-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Lock "cinder-3061b730-aac7-47c6-9b0f-3cdbbea5ba1b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-126d4d33-911e-4856-9328-2013623847ad" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-126d4d33-911e-4856-9328-2013623847ad" acquired by "delete_snapshot" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Deleting offline snapshot 3061b730-aac7-47c6-9b0f-3cdbbea5ba1b of volume 126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] snapshot_file for this snap is: volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b266bd3-889a-48eb-9db5-351284d9ffd4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:03 devstack sudo[106296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b Sep 03 12:11:03 devstack sudo[106296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:03 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa 1G" returned: 0 in 0.599s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:03 devstack sudo[106299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa Sep 03 12:11:03 devstack sudo[106299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:03 devstack sudo[106296]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" returned: 0 in 0.518s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-126d4d33-911e-4856-9328-2013623847ad(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:03 devstack sudo[106299]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa" returned: 0 in 0.330s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:03 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa is being set with open permissions: ugo+rw Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ea63ab7-8e8b-4b7c-90ce-cb2f445e0237]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:03 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa Sep 03 12:11:03 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:03 devstack sudo[106308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad Sep 03 12:11:03 devstack sudo[106308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:04 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa" returned: 0 in 0.335s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:04 devstack sudo[106313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.info Sep 03 12:11:04 devstack sudo[106313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:04 devstack sudo[106308]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad" returned: 0 in 0.495s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:04 devstack sudo[106319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b Sep 03 12:11:04 devstack sudo[106319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:04 devstack sudo[106313]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.info" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:04 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.info is being set with open permissions: ugo+rw Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:04 devstack sudo[106322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.info Sep 03 12:11:04 devstack sudo[106322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:04 devstack sudo[106319]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" returned: 0 in 0.380s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:04 devstack sudo[106328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b Sep 03 12:11:04 devstack sudo[106328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:04 devstack sudo[106322]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.info" returned: 0 in 0.257s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.307s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-84308bb0-88c2-4947-b45a-8243a60f7590 tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:11:04 devstack sudo[106328]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad.3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" returned: 0 in 0.305s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-3061b730-aac7-47c6-9b0f-3cdbbea5ba1b" released by "_delete_snapshot" :: held 1.822s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-126d4d33-911e-4856-9328-2013623847ad" released by "delete_snapshot" :: held 1.848s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Created reservations ['57115169-7204-4ebc-ad83-524b0e394f39', 'd4b322b8-1e4f-48b3-91eb-8b8b87db279b', 'aa29e970-af3a-4763-9631-462dd6448968', '406740bf-d7b3-455c-b7c8-84f7e0944317'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:05 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Delete snapshot completed successfully. Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-45a5f602-1ddd-4cd4-b96d-ab07890f8d81 tempest-ProjectReaderTests-936188469 None] Lock "cinder-3061b730-aac7-47c6-9b0f-3cdbbea5ba1b-delete_snapshot" released by "delete_snapshot" :: held 1.998s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-126d4d33-911e-4856-9328-2013623847ad-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Lock "cinder-126d4d33-911e-4856-9328-2013623847ad-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-126d4d33-911e-4856-9328-2013623847ad" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-126d4d33-911e-4856-9328-2013623847ad" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[828bfc93-507b-490c-b2c6-9b034b89f91b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-ea110ab4-37ab-4470-a880-896996cadfaa-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Lock "cinder-ea110ab4-37ab-4470-a880-896996cadfaa-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-bfd8bbe6-1334-45fa-8563-b35d4a6be398" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-bfd8bbe6-1334-45fa-8563-b35d4a6be398" acquired by "delete_snapshot" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-ea110ab4-37ab-4470-a880-896996cadfaa" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-ea110ab4-37ab-4470-a880-896996cadfaa" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Deleting offline snapshot ea110ab4-37ab-4470-a880-896996cadfaa of volume bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fce10de-0acd-42ed-b1cf-820228ab8301]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:05 devstack sudo[106332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad Sep 03 12:11:05 devstack sudo[106332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:05 devstack sudo[106334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa Sep 03 12:11:05 devstack sudo[106334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:05 devstack sudo[106332]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad" returned: 0 in 0.484s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:06 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad Sep 03 12:11:06 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:06 devstack sudo[106334]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa" returned: 0 in 0.451s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fc98588-1ad0-4691-bb0f-1ee128f28cd9]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:06 devstack sudo[106345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 Sep 03 12:11:06 devstack sudo[106345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:06 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-126d4d33-911e-4856-9328-2013623847ad" returned: 0 in 0.285s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-126d4d33-911e-4856-9328-2013623847ad" released by "delete_volume" :: held 0.850s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Created reservations ['d1635e3b-edd8-4d0f-b11a-b2c8f8c89230', '1a834d78-b5f7-429e-9e6d-dbff52ef04ba', '2b7c85b7-8cca-4431-bbfa-46ab864b336d', 'b458c041-88b1-4f7c-99eb-814de5a9fcc6'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:06 devstack sudo[106352]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:06 devstack sudo[106352]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:06 devstack sudo[106345]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398" returned: 0 in 0.425s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:06 devstack sudo[106354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa Sep 03 12:11:06 devstack sudo[106354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:06 devstack sudo[106352]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.274s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Deleted volume successfully. Sep 03 12:11:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-01e7de5c-e799-42bc-8ea5-ce287a2b217e tempest-ProjectReaderTests-936188469 None] Lock "cinder-126d4d33-911e-4856-9328-2013623847ad-delete_volume" released by "delete_volume" :: held 1.468s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:06 devstack sudo[106354]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa" returned: 0 in 0.468s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:07 devstack sudo[106361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa Sep 03 12:11:07 devstack sudo[106361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (b624c267-22a2-4106-a8ae-74dc03370b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61aa883-c17d-4962-8813-206b56ab319c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f61aa883-c17d-4962-8813-206b56ab319c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395663002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84137fa-6430-4ac3-850f-e6869cebcdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:07Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34268ce5-8048-4c8d-a79d-fd2f24eae7f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (34268ce5-8048-4c8d-a79d-fd2f24eae7f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd16b74-5345-4346-b0e4-76f49b34e66d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abd16b74-5345-4346-b0e4-76f49b34e66d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b84137fa-6430-4ac3-850f-e6869cebcdfc', 'volume_name': 'volume-b84137fa-6430-4ac3-850f-e6869cebcdfc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6084e942-2e4f-4a01-b5f9-25e5252d6b07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6084e942-2e4f-4a01-b5f9-25e5252d6b07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b250e8a6-eb50-4443-926d-371748653438) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:07 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Volume b84137fa-6430-4ac3-850f-e6869cebcdfc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b84137fa-6430-4ac3-850f-e6869cebcdfc', 'volume_size': 1} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-395663002',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b84137fa-6430-4ac3-850f-e6869cebcdfc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:07Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Creating volume b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:07 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:07 devstack sudo[106363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc 1073741824 Sep 03 12:11:07 devstack sudo[106363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:07 devstack sudo[106361]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398.ea110ab4-37ab-4470-a880-896996cadfaa" returned: 0 in 0.312s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-ea110ab4-37ab-4470-a880-896996cadfaa" released by "_delete_snapshot" :: held 1.799s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-bfd8bbe6-1334-45fa-8563-b35d4a6be398" released by "delete_snapshot" :: held 1.824s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Created reservations ['db9e3c5a-e79c-48b6-9968-c51dfe094c0c', '532273af-783b-461b-99a7-bdba3b2d8f04', '66876227-d802-4b5f-b790-d11eebbea74e', '45b4cc71-86b2-489f-9679-4c7effe7458f'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:07 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d203ab4c-3dbe-4207-b2c3-64d7ff9c26c6 tempest-ProjectMemberTests-990816 None] Lock "cinder-ea110ab4-37ab-4470-a880-896996cadfaa-delete_snapshot" released by "delete_snapshot" :: held 1.989s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:07 devstack sudo[106363]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc 1073741824" returned: 0 in 0.493s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-bfd8bbe6-1334-45fa-8563-b35d4a6be398-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:07 devstack sudo[106370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc Sep 03 12:11:07 devstack sudo[106370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Lock "cinder-bfd8bbe6-1334-45fa-8563-b35d4a6be398-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-bfd8bbe6-1334-45fa-8563-b35d4a6be398" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-bfd8bbe6-1334-45fa-8563-b35d4a6be398" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[36f36c21-9bea-42f1-b285-fb058e443ea1]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:07 devstack sudo[106370]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc" returned: 0 in 0.299s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:07 devstack sudo[106372]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] <== create_volume: return (841ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.845s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:07 devstack sudo[106372]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b250e8a6-eb50-4443-926d-371748653438) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b84137fa-6430-4ac3-850f-e6869cebcdfc', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3ef390-323f-4222-993f-1fce6019b0ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:08 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Volume volume-b84137fa-6430-4ac3-850f-e6869cebcdfc (b84137fa-6430-4ac3-850f-e6869cebcdfc): created successfully Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ed3ef390-323f-4222-993f-1fce6019b0ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (b624c267-22a2-4106-a8ae-74dc03370b60) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8cfb19eb-7f32-40f9-850b-2cbab65bb580 tempest-ProjectReaderTests-936188469 None] Created volume successfully. Sep 03 12:11:08 devstack sudo[106372]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398" returned: 0 in 0.411s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:08 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398 Sep 03 12:11:08 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:08 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bfd8bbe6-1334-45fa-8563-b35d4a6be398" returned: 0 in 0.281s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-bfd8bbe6-1334-45fa-8563-b35d4a6be398" released by "delete_volume" :: held 0.760s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Created reservations ['9c991c5b-c574-4d9d-a875-3bf68883de5b', '1acffbf3-141f-4c63-8b64-aca9e2e76b1b', 'd53d35d4-3ddc-479f-9c19-13d895e9b546', '4512893d-654d-4258-9cc3-dc05638007cb'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:08 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:08 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:08 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.252s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:08 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fb6e4429-6614-4700-b047-1cb2dadca750 tempest-ProjectMemberTests-990816 None] Lock "cinder-bfd8bbe6-1334-45fa-8563-b35d4a6be398-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (64dad3bd-4058-4090-a1a7-206f45792d5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f88f17-cc47-4407-8184-e40755e51ddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Creating offline snapshot 94be5f70-5b8e-49de-b7ef-3727348ac928 of volume b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (53f88f17-cc47-4407-8184-e40755e51ddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143542813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1923fa-8c3d-49c1-95e4-163a0142624f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:09Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179ffa29-b98c-4177-8ca4-10a77b56802b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (179ffa29-b98c-4177-8ca4-10a77b56802b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b66a3a4-4fe9-41c9-b0e4-0a29f4bf64f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b66a3a4-4fe9-41c9-b0e4-0a29f4bf64f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b1923fa-8c3d-49c1-95e4-163a0142624f', 'volume_name': 'volume-0b1923fa-8c3d-49c1-95e4-163a0142624f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed210f1-05f2-4123-b7b9-0deb5d872e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (aed210f1-05f2-4123-b7b9-0deb5d872e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2e7fb2-1a30-472f-974e-449f2e5e3c31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:09 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Volume 0b1923fa-8c3d-49c1-95e4-163a0142624f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b1923fa-8c3d-49c1-95e4-163a0142624f', 'volume_size': 1} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[37831b28-51d0-434b-a560-7850fd416e32]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:09 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc Sep 03 12:11:09 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:10 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc" returned: 0 in 0.422s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:10 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 1G Sep 03 12:11:10 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:10 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 1G" returned: 0 in 0.415s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84137fa-6430-4ac3-850f-e6869cebcdfc -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:10 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84137fa-6430-4ac3-850f-e6869cebcdfc -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 Sep 03 12:11:10 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:10 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b84137fa-6430-4ac3-850f-e6869cebcdfc -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:10 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 is being set with open permissions: ugo+rw Sep 03 12:11:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:10 devstack sudo[106400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 Sep 03 12:11:10 devstack sudo[106400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:11 devstack sudo[106400]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:11 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.info Sep 03 12:11:11 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:11 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.info" returned: 0 in 0.265s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:11 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.info is being set with open permissions: ugo+rw Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:11 devstack sudo[106406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.info Sep 03 12:11:11 devstack sudo[106406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:11 devstack sudo[106406]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.info" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.123s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.967s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2143542813',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b1923fa-8c3d-49c1-95e4-163a0142624f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:09Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Creating volume 0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:11 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:11 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f 1073741824 Sep 03 12:11:11 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ad90b34b-3fdb-45f0-862b-91f67ac2c12b tempest-ProjectReaderTests-936188469 None] Create snapshot completed successfully Sep 03 12:11:12 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f 1073741824" returned: 0 in 0.465s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:12 devstack sudo[106415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f Sep 03 12:11:12 devstack sudo[106415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:12 devstack sudo[106415]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] <== create_volume: return (839ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2a2e7fb2-1a30-472f-974e-449f2e5e3c31) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b1923fa-8c3d-49c1-95e4-163a0142624f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03ca7f2-d226-4faa-8d51-990e75715404) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-94be5f70-5b8e-49de-b7ef-3727348ac928-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:12 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Volume volume-0b1923fa-8c3d-49c1-95e4-163a0142624f (0b1923fa-8c3d-49c1-95e4-163a0142624f): created successfully Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a03ca7f2-d226-4faa-8d51-990e75715404) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (64dad3bd-4058-4090-a1a7-206f45792d5f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:12 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b644e894-78a8-4c6f-a452-27b846c0855e tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Lock "cinder-94be5f70-5b8e-49de-b7ef-3727348ac928-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-b84137fa-6430-4ac3-850f-e6869cebcdfc" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-b84137fa-6430-4ac3-850f-e6869cebcdfc" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-94be5f70-5b8e-49de-b7ef-3727348ac928" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-94be5f70-5b8e-49de-b7ef-3727348ac928" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Deleting offline snapshot 94be5f70-5b8e-49de-b7ef-3727348ac928 of volume b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] snapshot_file for this snap is: volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[61374ce0-4ade-490e-8885-3e0ef5d1a2d8]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:12 devstack sudo[106418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 Sep 03 12:11:12 devstack sudo[106418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:13 devstack sudo[106418]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928" returned: 0 in 0.379s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b84137fa-6430-4ac3-850f-e6869cebcdfc(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c5ea345-ca5a-4370-a6fe-b61af785f55e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:13 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc Sep 03 12:11:13 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:13 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc" returned: 0 in 0.380s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:13 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 Sep 03 12:11:13 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:13 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928" returned: 0 in 0.416s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Creating offline snapshot dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 of volume 0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:13 devstack sudo[106433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928 Sep 03 12:11:13 devstack sudo[106433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[edb144f6-7ba4-4bf8-8dd3-6ad384d00d51]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:14 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f Sep 03 12:11:14 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:14 devstack sudo[106433]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc.94be5f70-5b8e-49de-b7ef-3727348ac928" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-94be5f70-5b8e-49de-b7ef-3727348ac928" released by "_delete_snapshot" :: held 1.556s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-b84137fa-6430-4ac3-850f-e6869cebcdfc" released by "delete_snapshot" :: held 1.580s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Created reservations ['f1cda275-2486-48cd-9fef-8e7001cf3809', '752961e9-a5c8-41b0-abb9-c69cf8a097aa', '6bf58c5a-0d42-4ebe-911a-95d334df1095', '36cd940a-6cc7-4ccb-a6f2-273d1219c9ff'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:14 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f" returned: 0 in 0.403s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:14 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Delete snapshot completed successfully. Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1288a7b6-9160-4f24-87f9-906982acc705 tempest-ProjectReaderTests-936188469 None] Lock "cinder-94be5f70-5b8e-49de-b7ef-3727348ac928-delete_snapshot" released by "delete_snapshot" :: held 1.757s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:14 devstack sudo[106442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 1G Sep 03 12:11:14 devstack sudo[106442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-b84137fa-6430-4ac3-850f-e6869cebcdfc-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Lock "cinder-b84137fa-6430-4ac3-850f-e6869cebcdfc-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:14 devstack sudo[106442]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 1G" returned: 0 in 0.532s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1923fa-8c3d-49c1-95e4-163a0142624f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-b84137fa-6430-4ac3-850f-e6869cebcdfc" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-b84137fa-6430-4ac3-850f-e6869cebcdfc" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:14 devstack sudo[106447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1923fa-8c3d-49c1-95e4-163a0142624f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 Sep 03 12:11:14 devstack sudo[106447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7c2afa7-4687-4f8e-a25f-c29ea8bf7839]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:15 devstack sudo[106449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc Sep 03 12:11:15 devstack sudo[106449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:15 devstack sudo[106447]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b1923fa-8c3d-49c1-95e4-163a0142624f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" returned: 0 in 0.442s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:15 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 is being set with open permissions: ugo+rw Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:15 devstack sudo[106454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 Sep 03 12:11:15 devstack sudo[106454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:15 devstack sudo[106449]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc" returned: 0 in 0.520s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:15 devstack sudo[106459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc Sep 03 12:11:15 devstack sudo[106459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:15 devstack sudo[106454]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" returned: 0 in 0.342s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:15 devstack sudo[106462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.info Sep 03 12:11:15 devstack sudo[106462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:15 devstack sudo[106459]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-b84137fa-6430-4ac3-850f-e6869cebcdfc" returned: 0 in 0.360s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-b84137fa-6430-4ac3-850f-e6869cebcdfc" released by "delete_volume" :: held 0.960s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:15 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Created reservations ['3bbbc254-4440-429e-8bc2-5bebb1ea679f', '4f330fe9-2533-4331-8746-d108bc506298', '77f69df1-a35f-4113-995b-b289c7b11353', '8da5604b-e27d-4d24-a544-39491e32b90a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:16 devstack sudo[106462]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.info" returned: 0 in 0.354s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:16 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.info is being set with open permissions: ugo+rw Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:16 devstack sudo[106466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:16 devstack sudo[106466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:16 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.info Sep 03 12:11:16 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:16 devstack sudo[106466]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:16 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.268s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.info" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:16 devstack sudo[106472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:16 devstack sudo[106472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.435s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Deleted volume successfully. Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-eb34fa4f-8a5f-4d35-9b1a-9b5e0d012642 tempest-ProjectReaderTests-936188469 None] Lock "cinder-b84137fa-6430-4ac3-850f-e6869cebcdfc-delete_volume" released by "delete_volume" :: held 1.577s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-626d3cff-ea90-47e3-b824-730287ceb25b tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:16 devstack sudo[106472]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Flow 'volume_create_manager' (2f369d9f-994a-409c-b81f-e7d2acb588c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a784c43f-057c-4ecc-b307-a97287cd167b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.314s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 29 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a784c43f-057c-4ecc-b307-a97287cd167b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-226676285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a715bc2-c306-4e6e-9465-cebf9ff76e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0535766da914584b440232fb0cf0410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:17Z,use_quota=True,user_id='12394a5a157a4bb6b272946feb2a4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b9be96-2e8b-4596-a197-1366404d2aa1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (43b9be96-2e8b-4596-a197-1366404d2aa1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d021e7-2274-48fb-affe-105eebac010e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (70d021e7-2274-48fb-affe-105eebac010e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a715bc2-c306-4e6e-9465-cebf9ff76e13', 'volume_name': 'volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee94284e-eb4e-4367-b9eb-b8cc5837bee9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee94284e-eb4e-4367-b9eb-b8cc5837bee9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a362b-b9af-44b8-bb11-b508305d51b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:16 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Volume 7a715bc2-c306-4e6e-9465-cebf9ff76e13: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13', 'volume_size': 1} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-226676285',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a715bc2-c306-4e6e-9465-cebf9ff76e13,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0535766da914584b440232fb0cf0410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:17Z,use_quota=True,user_id='12394a5a157a4bb6b272946feb2a4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Creating volume 7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:16 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:16 devstack sudo[106475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 1073741824 Sep 03 12:11:16 devstack sudo[106475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-dab5b4cd-2f70-4a76-8fca-9b96ea1fa293-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Lock "cinder-dab5b4cd-2f70-4a76-8fca-9b96ea1fa293-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-0b1923fa-8c3d-49c1-95e4-163a0142624f" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-0b1923fa-8c3d-49c1-95e4-163a0142624f" acquired by "delete_snapshot" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Deleting offline snapshot dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 of volume 0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:17 devstack sudo[106475]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 1073741824" returned: 0 in 0.500s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[47d594bd-33e6-4a2b-8659-675fad44e52a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:17 devstack sudo[106481]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 Sep 03 12:11:17 devstack sudo[106481]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:17 devstack sudo[106480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 Sep 03 12:11:17 devstack sudo[106480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:17 devstack sudo[106481]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13" returned: 0 in 0.301s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] <== create_volume: return (869ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.872s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (211a362b-b9af-44b8-bb11-b508305d51b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d957081-20a3-49bf-ae04-50fc1fe26214) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:17 devstack sudo[106480]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:17 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Volume volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 (7a715bc2-c306-4e6e-9465-cebf9ff76e13): created successfully Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8d957081-20a3-49bf-ae04-50fc1fe26214) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Flow 'volume_create_manager' (2f369d9f-994a-409c-b81f-e7d2acb588c9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (09955b53-6c0c-4e88-9011-4afdbe1ddd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8cc13b-cc17-4aeb-a01f-839565980ba8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" returned: 0 in 0.461s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b1923fa-8c3d-49c1-95e4-163a0142624f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4e8cc13b-cc17-4aeb-a01f-839565980ba8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793413874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5425e41d-62b0-49de-af0a-bc96e125f798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:18Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9bd75-1559-489a-9efb-2612a1832259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dcd9bd75-1559-489a-9efb-2612a1832259) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c16bbd-975e-4e7e-96e3-e07574a9a1f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38c16bbd-975e-4e7e-96e3-e07574a9a1f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5425e41d-62b0-49de-af0a-bc96e125f798', 'volume_name': 'volume-5425e41d-62b0-49de-af0a-bc96e125f798', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e13ed-d759-4607-ab7d-4150509b9b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2b8e13ed-d759-4607-ab7d-4150509b9b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f548b5bf-718e-4e6a-9a2d-bfe21b564e58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:17 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Volume 5425e41d-62b0-49de-af0a-bc96e125f798: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5425e41d-62b0-49de-af0a-bc96e125f798', 'volume_size': 1} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-793413874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5425e41d-62b0-49de-af0a-bc96e125f798,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:18Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Creating volume 5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:17 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[71d6c543-e75b-4f5a-aa1d-d8e4f35e958a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:17 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d05aada1-8b2d-4a80-a310-702ed654ba30 tempest-SnapshotDependencyTests-472287953 None] Created volume successfully. Sep 03 12:11:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:17 devstack sudo[106488]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 1073741824 Sep 03 12:11:17 devstack sudo[106488]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:17 devstack sudo[106489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f Sep 03 12:11:17 devstack sudo[106489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:18 devstack sudo[106489]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f" returned: 0 in 0.381s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:18 devstack sudo[106488]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 1073741824" returned: 0 in 0.414s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:18 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 Sep 03 12:11:18 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:18 devstack sudo[106502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 Sep 03 12:11:18 devstack sudo[106502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:18 devstack sudo[106502]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798" returned: 0 in 0.248s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] <== create_volume: return (705ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f548b5bf-718e-4e6a-9a2d-bfe21b564e58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5425e41d-62b0-49de-af0a-bc96e125f798', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463479ea-f503-4cb2-a3b5-64b9bef62788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:18 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" returned: 0 in 0.328s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:18 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Volume volume-5425e41d-62b0-49de-af0a-bc96e125f798 (5425e41d-62b0-49de-af0a-bc96e125f798): created successfully Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (463479ea-f503-4cb2-a3b5-64b9bef62788) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (09955b53-6c0c-4e88-9011-4afdbe1ddd58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:18 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293 Sep 03 12:11:18 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-40121919-979a-409b-a768-a6f6a069adab tempest-ProjectReaderTests-936188469 None] Created volume successfully. Sep 03 12:11:18 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f.dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-dab5b4cd-2f70-4a76-8fca-9b96ea1fa293" released by "_delete_snapshot" :: held 1.631s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-0b1923fa-8c3d-49c1-95e4-163a0142624f" released by "delete_snapshot" :: held 1.655s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Creating offline snapshot 8f10c062-10ca-4be6-bdfd-f4b312efe65b of volume 5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[563a261f-5426-426b-b9db-83451451bca5]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Created reservations ['f18c2b26-e9f6-4d79-a867-cae7dff754a7', '4d5cc28e-7a54-4850-a784-1634804a49a4', '7b436322-e312-472c-a2ee-e37f0561f8da', 'f7252381-fe6a-4bd3-adcb-008b9f371a47'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:11:18 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-d739079a-addc-4f79-af17-c0549626971c tempest-ProjectMemberTests-990816 None] Lock "cinder-dab5b4cd-2f70-4a76-8fca-9b96ea1fa293-delete_snapshot" released by "delete_snapshot" :: held 1.878s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:18 devstack sudo[106511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 Sep 03 12:11:18 devstack sudo[106511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:19 devstack sudo[106511]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798" returned: 0 in 0.405s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:19 devstack sudo[106517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b 1G Sep 03 12:11:19 devstack sudo[106517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-0b1923fa-8c3d-49c1-95e4-163a0142624f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Lock "cinder-0b1923fa-8c3d-49c1-95e4-163a0142624f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-0b1923fa-8c3d-49c1-95e4-163a0142624f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-0b1923fa-8c3d-49c1-95e4-163a0142624f" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[498ad384-64aa-4328-b30f-df790f293429]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:19 devstack sudo[106519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f Sep 03 12:11:19 devstack sudo[106519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:19 devstack sudo[106517]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b 1G" returned: 0 in 0.404s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5425e41d-62b0-49de-af0a-bc96e125f798 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:19 devstack sudo[106525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5425e41d-62b0-49de-af0a-bc96e125f798 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b Sep 03 12:11:19 devstack sudo[106525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:19 devstack sudo[106519]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f" returned: 0 in 0.398s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:19 devstack sudo[106530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f Sep 03 12:11:19 devstack sudo[106530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:19 devstack sudo[106525]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5425e41d-62b0-49de-af0a-bc96e125f798 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b" returned: 0 in 0.336s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:19 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b is being set with open permissions: ugo+rw Sep 03 12:11:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:19 devstack sudo[106535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b Sep 03 12:11:19 devstack sudo[106535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:20 devstack sudo[106530]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-0b1923fa-8c3d-49c1-95e4-163a0142624f" returned: 0 in 0.268s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-0b1923fa-8c3d-49c1-95e4-163a0142624f" released by "delete_volume" :: held 0.719s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Created reservations ['67f2a6ec-9ce7-4ef0-8c7f-d4c5010bde0b', '1fe74305-ce79-4d8e-9c10-49043becac28', 'dc5f3c72-cf8e-431e-9a09-89acf5c0fd7c', 'd6e7b4e4-f293-4195-9880-abb02b96ef19'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:20 devstack sudo[106535]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:20 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:20 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:20 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.info Sep 03 12:11:20 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:20 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.260s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc921b33-cf68-4bf5-9fc9-c76eb9c29168 tempest-ProjectMemberTests-990816 None] Lock "cinder-0b1923fa-8c3d-49c1-95e4-163a0142624f-delete_volume" released by "delete_volume" :: held 1.204s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:20 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.info" returned: 0 in 0.274s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:20 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.info is being set with open permissions: ugo+rw Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:20 devstack sudo[106546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.info Sep 03 12:11:20 devstack sudo[106546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:20 devstack sudo[106546]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.info" returned: 0 in 0.262s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.020s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.879s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Creating offline snapshot bccb3743-2cba-41cc-af9b-123a44a95040 of volume 7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6bd7b701-cea3-4288-9bc2-4bcc73fbb124 tempest-ProjectReaderTests-936188469 None] Create snapshot completed successfully Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[54791a2b-e677-4c42-bed4-a9c39ce3b0ec]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (b838ccf7-5492-44d3-a2f0-89801f3df491) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:20 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e360466-fa53-4160-b586-6bba11a5628b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:20 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 Sep 03 12:11:20 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e360466-fa53-4160-b586-6bba11a5628b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-143894070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d987bdd-47ff-45d9-8f7d-81771abc541c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:21Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe762074-48ca-44b8-93fc-d131f31f8bd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fe762074-48ca-44b8-93fc-d131f31f8bd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4533b14b-afb5-4c36-8043-6fc39506991b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4533b14b-afb5-4c36-8043-6fc39506991b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d987bdd-47ff-45d9-8f7d-81771abc541c', 'volume_name': 'volume-7d987bdd-47ff-45d9-8f7d-81771abc541c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfdc374-003c-4926-82a8-cdca78faf6ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1bfdc374-003c-4926-82a8-cdca78faf6ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8da1ba-dcb4-4625-91e6-56f91f205ea3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:21 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Volume 7d987bdd-47ff-45d9-8f7d-81771abc541c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d987bdd-47ff-45d9-8f7d-81771abc541c', 'volume_size': 1} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:21 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13" returned: 0 in 0.365s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:21 devstack sudo[106554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 1G Sep 03 12:11:21 devstack sudo[106554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:21 devstack sudo[106554]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 1G" returned: 0 in 0.382s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:21 devstack sudo[106559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 Sep 03 12:11:21 devstack sudo[106559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:21 devstack sudo[106559]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040" returned: 0 in 0.294s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:21 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 is being set with open permissions: ugo+rw Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-8f10c062-10ca-4be6-bdfd-f4b312efe65b-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:21 devstack sudo[106564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 Sep 03 12:11:21 devstack sudo[106564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Lock "cinder-8f10c062-10ca-4be6-bdfd-f4b312efe65b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-5425e41d-62b0-49de-af0a-bc96e125f798" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-5425e41d-62b0-49de-af0a-bc96e125f798" acquired by "delete_snapshot" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-8f10c062-10ca-4be6-bdfd-f4b312efe65b" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-8f10c062-10ca-4be6-bdfd-f4b312efe65b" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Deleting offline snapshot 8f10c062-10ca-4be6-bdfd-f4b312efe65b of volume 5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] snapshot_file for this snap is: volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a748e3b-dbf8-4ab6-a93e-2c1693223b39]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:22 devstack sudo[106566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b Sep 03 12:11:22 devstack sudo[106566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:22 devstack sudo[106564]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040" returned: 0 in 0.270s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:22 devstack sudo[106569]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.info Sep 03 12:11:22 devstack sudo[106569]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:22 devstack sudo[106566]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b" returned: 0 in 0.399s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5425e41d-62b0-49de-af0a-bc96e125f798(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2d677302-1729-449b-97e7-592e2ea58f82]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:22 devstack sudo[106569]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.info" returned: 0 in 0.265s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:22 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.info is being set with open permissions: ugo+rw Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:22 devstack sudo[106576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.info Sep 03 12:11:22 devstack sudo[106576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:22 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 Sep 03 12:11:22 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:22 devstack sudo[106576]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.info" returned: 0 in 0.257s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.959s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.734s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-143894070',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d987bdd-47ff-45d9-8f7d-81771abc541c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:21Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Creating volume 7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:22 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:22 devstack sudo[106583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c 1073741824 Sep 03 12:11:22 devstack sudo[106583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-e2a465dd-4217-4927-888d-70f9602ec36f tempest-SnapshotDependencyTests-472287953 None] Create snapshot completed successfully Sep 03 12:11:22 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798" returned: 0 in 0.376s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:22 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b Sep 03 12:11:22 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:23 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b" returned: 0 in 0.366s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:23 devstack sudo[106583]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c 1073741824" returned: 0 in 0.464s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:23 devstack sudo[106596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b Sep 03 12:11:23 devstack sudo[106596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:23 devstack sudo[106598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c Sep 03 12:11:23 devstack sudo[106598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:23 devstack sudo[106596]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798.8f10c062-10ca-4be6-bdfd-f4b312efe65b" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-8f10c062-10ca-4be6-bdfd-f4b312efe65b" released by "_delete_snapshot" :: held 1.494s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-5425e41d-62b0-49de-af0a-bc96e125f798" released by "delete_snapshot" :: held 1.531s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:23 devstack sudo[106598]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c" returned: 0 in 0.287s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5f8da1ba-dcb4-4625-91e6-56f91f205ea3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d987bdd-47ff-45d9-8f7d-81771abc541c', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a55ae5e-7992-4181-af11-0eb93cf3c835) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Volume volume-7d987bdd-47ff-45d9-8f7d-81771abc541c (7d987bdd-47ff-45d9-8f7d-81771abc541c): created successfully Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a55ae5e-7992-4181-af11-0eb93cf3c835) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (b838ccf7-5492-44d3-a2f0-89801f3df491) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Created reservations ['fe0f42af-79cd-4545-8bf3-6256e81e95eb', '66870135-08a9-42d3-baec-f577496c3733', '4120b349-d876-4d56-9bbe-563b76b5b12c', '53fde9e1-8cf7-452d-b50a-417e12723aa4'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ce4d64b7-ce0f-4f7e-a55a-e651dd6c8819 tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:11:23 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Delete snapshot completed successfully. Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-608b5f3d-29a8-4135-87d5-28e464d691aa tempest-ProjectReaderTests-936188469 None] Lock "cinder-8f10c062-10ca-4be6-bdfd-f4b312efe65b-delete_snapshot" released by "delete_snapshot" :: held 1.748s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Flow 'volume_create_manager' (ff7d2183-3765-4f30-ad1b-e0440707a2fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e820f60-2098-4a0f-8578-669fad4a83f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1e820f60-2098-4a0f-8578-669fad4a83f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:23Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bf75d12d-0c1b-4b17-9821-7bbf98cf20ce,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b0535766da914584b440232fb0cf0410',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=bccb3743-2cba-41cc-af9b-123a44a95040,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:24Z,use_quota=True,user_id='12394a5a157a4bb6b272946feb2a4473',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6545d21-e81d-4343-8236-5f7be53580c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c6545d21-e81d-4343-8236-5f7be53580c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21e68d5-8e5e-47ab-ba97-ecd0cf3e920f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b21e68d5-8e5e-47ab-ba97-ecd0cf3e920f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bf75d12d-0c1b-4b17-9821-7bbf98cf20ce', 'volume_name': 'volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce', 'volume_size': 1, 'snapshot_id': 'bccb3743-2cba-41cc-af9b-123a44a95040'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9017670a-8924-43a7-909e-50cb8d0f9118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9017670a-8924-43a7-909e-50cb8d0f9118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd685c4b-60f8-46d0-a52e-90b30a7f7029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:23 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Volume bf75d12d-0c1b-4b17-9821-7bbf98cf20ce: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce', 'volume_size': 1, 'snapshot_id': 'bccb3743-2cba-41cc-af9b-123a44a95040'} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-quobyte-bccb3743-2cba-41cc-af9b-123a44a95040-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" by "_create_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bccb3743-2cba-41cc-af9b-123a44a95040-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" acquired by "_create_volume_from_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Creating volume bf75d12d-0c1b-4b17-9821-7bbf98cf20ce from snapshot bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-quobyte-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" by "_copy_volume_from_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] snapshot: bccb3743-2cba-41cc-af9b-123a44a95040, volume: bf75d12d-0c1b-4b17-9821-7bbf98cf20ce, {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f37255d2-286f-44f3-8189-9361265ed50e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:23 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:24 devstack sudo[106602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 Sep 03 12:11:24 devstack sudo[106602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-5425e41d-62b0-49de-af0a-bc96e125f798-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Lock "cinder-5425e41d-62b0-49de-af0a-bc96e125f798-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-5425e41d-62b0-49de-af0a-bc96e125f798" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-5425e41d-62b0-49de-af0a-bc96e125f798" acquired by "delete_volume" :: waited 0.025s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[abff57d9-890f-4286-ae48-01a094dbe491]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:24 devstack sudo[106602]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040" returned: 0 in 0.424s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:24 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 Sep 03 12:11:24 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b85515c7-5469-4bfb-9f24-d3742b9cb88d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:24 devstack sudo[106610]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 Sep 03 12:11:24 devstack sudo[106610]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:24 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798" returned: 0 in 0.360s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:24 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798 Sep 03 12:11:24 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:24 devstack sudo[106610]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13" returned: 0 in 0.374s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] will copy from snapshot at /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Creating direct copy from snapshot {{(pid=87256) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.utils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Path /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce not found in is_blk_device check {{(pid=87256) is_blk_device /opt/stack/cinder/cinder/utils.py:622}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:24 devstack sudo[106620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce Sep 03 12:11:24 devstack sudo[106620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:24 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-5425e41d-62b0-49de-af0a-bc96e125f798" returned: 0 in 0.257s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-5425e41d-62b0-49de-af0a-bc96e125f798" released by "delete_volume" :: held 0.677s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:24 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Created reservations ['21bb8197-221c-45ff-b923-eb11527ea75e', '2e45cbfb-94b6-4242-9812-6edbd68bec77', '1369c129-c0bc-4eca-bbde-bf1fbb16a8e9', '22409dd0-551a-4ff8-b47f-ae3dd49ef593'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:25 devstack sudo[106626]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:25 devstack sudo[106626]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:25 devstack sudo[106626]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.308s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:25 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Deleted volume successfully. Sep 03 12:11:25 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-58aa5fb6-8af7-421c-b0bf-dca712bacb90 tempest-ProjectReaderTests-936188469 None] Lock "cinder-5425e41d-62b0-49de-af0a-bc96e125f798-delete_volume" released by "delete_volume" :: held 1.262s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (4dd327f4-15d1-4e8a-8641-a5e72ee4e442) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3986c8-c12f-4e8c-986b-af925887a24f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf3986c8-c12f-4e8c-986b-af925887a24f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551953767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe59ff14-877d-453a-a59b-78005777138f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:26Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920256b9-ec00-4005-93e1-4fe74f04fa58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (920256b9-ec00-4005-93e1-4fe74f04fa58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debdf01f-3dfb-41c7-be19-cbc68f6cac10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (debdf01f-3dfb-41c7-be19-cbc68f6cac10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe59ff14-877d-453a-a59b-78005777138f', 'volume_name': 'volume-fe59ff14-877d-453a-a59b-78005777138f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996aaa16-984c-4467-873b-3aeb968b9e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (996aaa16-984c-4467-873b-3aeb968b9e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dc8aea-f0ec-4c2d-a35d-dd25c7d151cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:26 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Volume fe59ff14-877d-453a-a59b-78005777138f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe59ff14-877d-453a-a59b-78005777138f', 'volume_size': 1} Sep 03 12:11:26 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:29 devstack sudo[106620]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" returned: 0 in 4.316s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.image.image_utils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Image conversion details: src /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13, size 1024.00 MB, duration 4.32 sec, destination /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce {{(pid=87256) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:536}} Sep 03 12:11:29 devstack cinder-volume[87256]: INFO cinder.image.image_utils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Converted 1024.00 MB image at 237.17 MB/s Sep 03 12:11:29 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce is being set with open permissions: ugo+rw Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:29 devstack sudo[106637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce Sep 03 12:11:29 devstack sudo[106637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:29 devstack sudo[106637]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" released by "_copy_volume_from_snapshot" :: held 5.449s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bccb3743-2cba-41cc-af9b-123a44a95040-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" released by "_create_volume_from_snapshot" :: held 5.505s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 5.522s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 5.130s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Creating offline snapshot 2a873725-11a2-4bcf-b288-cf5c9995d1d8 of volume 7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fd685c4b-60f8-46d0-a52e-90b30a7f7029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce', 'volume_size': 1, 'snapshot_id': 'bccb3743-2cba-41cc-af9b-123a44a95040'}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d0a494-5d83-400c-a770-9872b0009996) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[92bffcf8-462b-4862-9cbd-7297b4460342]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:29 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Volume volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce (bf75d12d-0c1b-4b17-9821-7bbf98cf20ce): created successfully Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a7d0a494-5d83-400c-a770-9872b0009996) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Flow 'volume_create_manager' (ff7d2183-3765-4f30-ad1b-e0440707a2fa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:29 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-89164493-23e2-4c00-b44e-8205be98b23a tempest-SnapshotDependencyTests-472287953 None] Created volume successfully. Sep 03 12:11:29 devstack sudo[106640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c Sep 03 12:11:29 devstack sudo[106640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:29 devstack sudo[106640]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c" returned: 0 in 0.356s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:29 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:29 devstack sudo[106645]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 1G Sep 03 12:11:29 devstack sudo[106645]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:30 devstack sudo[106645]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 1G" returned: 0 in 0.374s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d987bdd-47ff-45d9-8f7d-81771abc541c -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:30 devstack sudo[106651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d987bdd-47ff-45d9-8f7d-81771abc541c -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 Sep 03 12:11:30 devstack sudo[106651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-bccb3743-2cba-41cc-af9b-123a44a95040-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-bccb3743-2cba-41cc-af9b-123a44a95040-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-quobyte-7a715bc2-c306-4e6e-9465-cebf9ff76e13" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-7a715bc2-c306-4e6e-9465-cebf9ff76e13" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-quobyte-bccb3743-2cba-41cc-af9b-123a44a95040" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bccb3743-2cba-41cc-af9b-123a44a95040" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Deleting offline snapshot bccb3743-2cba-41cc-af9b-123a44a95040 of volume 7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] snapshot_file for this snap is: volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6b3e876-4808-4565-9d48-100d81458cf0]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:30 devstack sudo[106651]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-7d987bdd-47ff-45d9-8f7d-81771abc541c -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8" returned: 0 in 0.298s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:30 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 is being set with open permissions: ugo+rw Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:30 devstack sudo[106657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 Sep 03 12:11:30 devstack sudo[106657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:30 devstack sudo[106656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 Sep 03 12:11:30 devstack sudo[106656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:30 devstack sudo[106657]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8" returned: 0 in 0.255s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:30 devstack sudo[106663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.info Sep 03 12:11:30 devstack sudo[106663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:30 devstack sudo[106656]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040" returned: 0 in 0.378s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[471a8a44-a313-4be4-b14e-af7f69c4ebf4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:30 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:30 devstack sudo[106666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 Sep 03 12:11:30 devstack sudo[106666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:31 devstack sudo[106663]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.info" returned: 0 in 0.279s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:31 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.info is being set with open permissions: ugo+rw Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:31 devstack sudo[106703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.info Sep 03 12:11:31 devstack sudo[106703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:31 devstack sudo[106703]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.info" returned: 0 in 0.262s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.920s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.843s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-551953767',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe59ff14-877d-453a-a59b-78005777138f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='581a801f1e394eb5a1f80555beed9256',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:26Z,use_quota=True,user_id='58f2bb441eb64720949ea624fa434cab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Creating volume fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:31 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:31 devstack sudo[106710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f 1073741824 Sep 03 12:11:31 devstack sudo[106710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:31 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2de38f4f-bf75-4e5e-ad2e-45e7bfb415f8 tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:11:31 devstack sudo[106666]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13" returned: 0 in 0.571s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:31 devstack sudo[106713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 Sep 03 12:11:31 devstack sudo[106713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-2a873725-11a2-4bcf-b288-cf5c9995d1d8-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Lock "cinder-2a873725-11a2-4bcf-b288-cf5c9995d1d8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.022s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-7d987bdd-47ff-45d9-8f7d-81771abc541c" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-7d987bdd-47ff-45d9-8f7d-81771abc541c" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-2a873725-11a2-4bcf-b288-cf5c9995d1d8" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:31 devstack sudo[106710]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-2a873725-11a2-4bcf-b288-cf5c9995d1d8" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Deleting offline snapshot 2a873725-11a2-4bcf-b288-cf5c9995d1d8 of volume 7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:31 devstack sudo[106713]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040" returned: 0 in 0.416s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f 1073741824" returned: 0 in 0.504s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31b0731-b8a7-4f90-9779-a5e00f60f2f9]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:31 devstack sudo[106723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040 Sep 03 12:11:31 devstack sudo[106723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:31 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:31 devstack sudo[106726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f Sep 03 12:11:31 devstack sudo[106726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:31 devstack sudo[106724]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 Sep 03 12:11:31 devstack sudo[106724]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:32 devstack sudo[106723]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13.bccb3743-2cba-41cc-af9b-123a44a95040" returned: 0 in 0.252s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bccb3743-2cba-41cc-af9b-123a44a95040" released by "_delete_snapshot" :: held 1.717s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-7a715bc2-c306-4e6e-9465-cebf9ff76e13" released by "delete_snapshot" :: held 1.743s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:32 devstack sudo[106726]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f" returned: 0 in 0.252s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] <== create_volume: return (824ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3dc8aea-f0ec-4c2d-a35d-dd25c7d151cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe59ff14-877d-453a-a59b-78005777138f', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca70fbc-fa12-4d07-9244-1830243cf60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:32 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Volume volume-fe59ff14-877d-453a-a59b-78005777138f (fe59ff14-877d-453a-a59b-78005777138f): created successfully Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ca70fbc-fa12-4d07-9244-1830243cf60f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Flow 'volume_create_manager' (4dd327f4-15d1-4e8a-8641-a5e72ee4e442) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-a0fa84b1-0346-4b94-9430-ab6399857dfa tempest-ProjectReaderTests-936188469 None] Created volume successfully. Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Created reservations ['921323cc-4723-4d28-8374-7eb57380f682', 'fe8bc0bd-487b-4736-b7f5-11fb18761c3b', '77ec91da-be5a-42f0-b00b-074600e52647', '98c212ff-d771-48fb-a930-2294b862d11f'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:32 devstack sudo[106724]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8" returned: 0 in 0.407s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7d987bdd-47ff-45d9-8f7d-81771abc541c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4f7f858-9eed-4984-bcab-f960cff496a7]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:32 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Delete snapshot completed successfully. Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-8309726a-e09e-4bca-a43c-544751faafb6 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-bccb3743-2cba-41cc-af9b-123a44a95040-delete_snapshot" released by "delete_snapshot" :: held 1.971s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:32 devstack sudo[106735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c Sep 03 12:11:32 devstack sudo[106735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-7a715bc2-c306-4e6e-9465-cebf9ff76e13-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-7a715bc2-c306-4e6e-9465-cebf9ff76e13-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-quobyte-7a715bc2-c306-4e6e-9465-cebf9ff76e13" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-7a715bc2-c306-4e6e-9465-cebf9ff76e13" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[55fdb32e-0356-455a-ac6d-8cd693da101d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:32 devstack sudo[106735]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c" returned: 0 in 0.372s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:32 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:32 devstack sudo[106741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 Sep 03 12:11:32 devstack sudo[106741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:32 devstack sudo[106740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 Sep 03 12:11:32 devstack sudo[106740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Creating offline snapshot b0946a86-cae3-4e98-9bdd-de28db2da352 of volume fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[78047d20-b0fd-4782-8036-c992c7e25f6d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:33 devstack sudo[106741]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:33 devstack sudo[106740]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8" returned: 0 in 0.401s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13" returned: 0 in 0.431s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:33 devstack sudo[106753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8 Sep 03 12:11:33 devstack sudo[106753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:33 devstack sudo[106754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13 Sep 03 12:11:33 devstack sudo[106754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:33 devstack sudo[106752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f Sep 03 12:11:33 devstack sudo[106752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:33 devstack sudo[106753]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c.2a873725-11a2-4bcf-b288-cf5c9995d1d8" returned: 0 in 0.263s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:33 devstack sudo[106754]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7a715bc2-c306-4e6e-9465-cebf9ff76e13" returned: 0 in 0.277s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-2a873725-11a2-4bcf-b288-cf5c9995d1d8" released by "_delete_snapshot" :: held 1.565s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-7a715bc2-c306-4e6e-9465-cebf9ff76e13" released by "delete_volume" :: held 0.778s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-7d987bdd-47ff-45d9-8f7d-81771abc541c" released by "delete_snapshot" :: held 1.599s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:33 devstack sudo[106752]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f" returned: 0 in 0.411s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Created reservations ['f76e0eb1-0560-4ab3-8c71-5667e229064b', '58f1c820-2c66-49e0-a05a-3dd90c651265', 'f930e151-93af-4fdf-96ef-3c1ccc62e52a', '93cf175d-01f1-4d83-b296-764eaa23cb12'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:33 devstack sudo[106764]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 1G Sep 03 12:11:33 devstack sudo[106764]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Created reservations ['41b4f67d-2963-4d92-812c-72c697069329', '0d2028de-ed03-4d9c-b368-58cea4c5304c', '6d8ddd2a-6325-483d-a3a6-89fdf4b2a1d1', 'acad64fe-ed50-4f90-a15e-c84611821b40'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-5257505a-67b1-4917-bce8-7f03e39389e5 tempest-ProjectMemberTests-990816 None] Lock "cinder-2a873725-11a2-4bcf-b288-cf5c9995d1d8-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:33 devstack sudo[106766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:33 devstack sudo[106766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "cinder-quobyte-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[3761b730-274d-4aae-bc1f-f20b5b2c6c0d]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:33 devstack sudo[106766]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.288s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:33 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Deleted volume successfully. Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-30e3d30d-7eae-40f9-8523-b5824de0f8b7 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-7a715bc2-c306-4e6e-9465-cebf9ff76e13-delete_volume" released by "delete_volume" :: held 1.382s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-7d987bdd-47ff-45d9-8f7d-81771abc541c-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:33 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce Sep 03 12:11:33 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:33 devstack sudo[106764]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Lock "cinder-7d987bdd-47ff-45d9-8f7d-81771abc541c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 1G" returned: 0 in 0.524s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:33 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe59ff14-877d-453a-a59b-78005777138f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe59ff14-877d-453a-a59b-78005777138f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 Sep 03 12:11:34 devstack sudo[106776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-7d987bdd-47ff-45d9-8f7d-81771abc541c" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-7d987bdd-47ff-45d9-8f7d-81771abc541c" acquired by "delete_volume" :: waited 0.020s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[9736660f-7d92-49f5-910b-3ef2c4327461]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" returned: 0 in 0.418s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack sudo[106778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c Sep 03 12:11:34 devstack sudo[106778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce Sep 03 12:11:34 devstack sudo[106785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack sudo[106776]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe59ff14-877d-453a-a59b-78005777138f -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352" returned: 0 in 0.326s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 is being set with open permissions: ugo+rw Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 Sep 03 12:11:34 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack sudo[106785]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" returned: 0 in 0.262s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack sudo[106778]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-quobyte-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce" released by "delete_volume" :: held 0.718s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c" returned: 0 in 0.405s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c Sep 03 12:11:34 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Created reservations ['b9b37e2a-16e6-4fa4-b799-814cae2c50de', '3972cedf-5e7a-4b7c-8948-c0dc96ee5867', '58a96fd8-c743-4535-b6d7-08233ac42812', '1b806da8-386e-4c1e-879d-4c2f86c7e4f1'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:34 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352" returned: 0 in 0.275s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106797]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.info Sep 03 12:11:34 devstack sudo[106797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:34 devstack sudo[106799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-7d987bdd-47ff-45d9-8f7d-81771abc541c" returned: 0 in 0.263s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-7d987bdd-47ff-45d9-8f7d-81771abc541c" released by "delete_volume" :: held 0.727s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Created reservations ['1eb739e4-bce6-4124-a7bf-f796311dec29', '9ed576a8-793c-4a64-a28d-4effc9dd247d', '3d82f8c8-0a19-436e-b0de-dd1dde0e6ce9', '5b012158-c51e-4f33-8806-16849a4a6a6a'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:34 devstack sudo[106797]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106799]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.287s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.info" returned: 0 in 0.339s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:34 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.info is being set with open permissions: ugo+rw Sep 03 12:11:34 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:34 devstack sudo[106804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:34 devstack sudo[106804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:34 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Deleted volume successfully. Sep 03 12:11:35 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.info Sep 03 12:11:35 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6075be1f-2e95-4d89-bb65-3e02e5441095 tempest-SnapshotDependencyTests-472287953 None] Lock "cinder-bf75d12d-0c1b-4b17-9821-7bbf98cf20ce-delete_volume" released by "delete_volume" :: held 1.284s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:35 devstack sudo[106804]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.266s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-9a1a6c3a-c147-46b1-9fbf-ea4a50f27b94 tempest-ProjectMemberTests-990816 None] Lock "cinder-7d987bdd-47ff-45d9-8f7d-81771abc541c-delete_volume" released by "delete_volume" :: held 1.278s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:35 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.info" returned: 0 in 0.311s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.291s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:35 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9e58ca39-caae-4120-9b82-99a943a4c43f tempest-ProjectReaderTests-936188469 None] Create snapshot completed successfully Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (5a67e41b-eec2-4b5d-ba11-e3948ed8cc68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4db3a4-cb68-47ba-9ec7-71f4b7b3dfc7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bc4db3a4-cb68-47ba-9ec7-71f4b7b3dfc7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758312531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07703115-acb3-4da7-8a88-6ef7b5aaaad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:36Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f1605c-8702-452b-b453-e1c7989ce084) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4f1605c-8702-452b-b453-e1c7989ce084) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0411617e-8a99-4c94-a5ce-4322625e99a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0411617e-8a99-4c94-a5ce-4322625e99a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '07703115-acb3-4da7-8a88-6ef7b5aaaad2', 'volume_name': 'volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cd45bb-62da-4b73-94dc-b06fa78f1a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22cd45bb-62da-4b73-94dc-b06fa78f1a8a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d3f13c-1f16-4255-9302-b1709c9787f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:35 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Volume 07703115-acb3-4da7-8a88-6ef7b5aaaad2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2', 'volume_size': 1} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-758312531',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=07703115-acb3-4da7-8a88-6ef7b5aaaad2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:36Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Creating volume 07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:35 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:35 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:35 devstack sudo[106811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 1073741824 Sep 03 12:11:35 devstack sudo[106811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-b0946a86-cae3-4e98-9bdd-de28db2da352-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:36 devstack sudo[106811]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 1073741824" returned: 0 in 0.453s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Lock "cinder-b0946a86-cae3-4e98-9bdd-de28db2da352-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-fe59ff14-877d-453a-a59b-78005777138f" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-fe59ff14-877d-453a-a59b-78005777138f" acquired by "delete_snapshot" :: waited 0.023s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-b0946a86-cae3-4e98-9bdd-de28db2da352" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-b0946a86-cae3-4e98-9bdd-de28db2da352" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Deleting offline snapshot b0946a86-cae3-4e98-9bdd-de28db2da352 of volume fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:36 devstack sudo[106817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 Sep 03 12:11:36 devstack sudo[106817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] snapshot_file for this snap is: volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7794547-893a-49f9-b463-0c03c56c7a10]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:36 devstack sudo[106819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 Sep 03 12:11:36 devstack sudo[106819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:36 devstack sudo[106817]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2" returned: 0 in 0.332s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0d3f13c-1f16-4255-9302-b1709c9787f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83ec6d2-46cd-4792-8141-6fbecfc225af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:36 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Volume volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 (07703115-acb3-4da7-8a88-6ef7b5aaaad2): created successfully Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e83ec6d2-46cd-4792-8141-6fbecfc225af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (5a67e41b-eec2-4b5d-ba11-e3948ed8cc68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:36 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-556344de-3109-4d1b-80db-2cca6d83e860 tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:11:36 devstack sudo[106819]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352" returned: 0 in 0.396s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe59ff14-877d-453a-a59b-78005777138f(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[86d35c1a-78a8-4a62-a53f-a6aac76babdd]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:36 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:36 devstack sudo[106826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f Sep 03 12:11:36 devstack sudo[106826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:37 devstack sudo[106826]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f" returned: 0 in 0.369s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:37 devstack sudo[106832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 Sep 03 12:11:37 devstack sudo[106832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:37 devstack sudo[106832]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352" returned: 0 in 0.358s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:37 devstack sudo[106838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352 Sep 03 12:11:37 devstack sudo[106838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:37 devstack sudo[106838]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f.b0946a86-cae3-4e98-9bdd-de28db2da352" returned: 0 in 0.260s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-b0946a86-cae3-4e98-9bdd-de28db2da352" released by "_delete_snapshot" :: held 1.501s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-fe59ff14-877d-453a-a59b-78005777138f" released by "delete_snapshot" :: held 1.541s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Created reservations ['6391a6dc-3279-4b6e-9d16-7621c42f5f06', '64ff2d70-4b24-4468-a1d4-2f95a4924c76', '39dbd4ad-acac-4fac-a68f-41154e68f4b0', '4f0695cc-f932-47b7-a129-0363a31b9224'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Creating offline snapshot f4642412-0969-48db-951e-3abe68798a4a of volume 07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[8263acb3-3035-4827-87b4-6301f8fc05fd]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:37 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:38 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Delete snapshot completed successfully. Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-0729972c-56b9-473d-9a21-db4737e380d2 tempest-ProjectReaderTests-936188469 None] Lock "cinder-b0946a86-cae3-4e98-9bdd-de28db2da352-delete_snapshot" released by "delete_snapshot" :: held 1.769s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:38 devstack sudo[106841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 Sep 03 12:11:38 devstack sudo[106841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:38 devstack sudo[106841]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2" returned: 0 in 0.386s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-fe59ff14-877d-453a-a59b-78005777138f-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:38 devstack sudo[106846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a 1G Sep 03 12:11:38 devstack sudo[106846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Lock "cinder-fe59ff14-877d-453a-a59b-78005777138f-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Acquiring lock "cinder-quobyte-fe59ff14-877d-453a-a59b-78005777138f" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-fe59ff14-877d-453a-a59b-78005777138f" acquired by "delete_volume" :: waited 0.050s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca8023da-7a75-4cff-91d7-cae85f52ce21]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:38 devstack sudo[106848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f Sep 03 12:11:38 devstack sudo[106848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:38 devstack sudo[106846]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a 1G" returned: 0 in 0.544s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:38 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:38 devstack sudo[106856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a Sep 03 12:11:38 devstack sudo[106856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:39 devstack sudo[106848]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f" returned: 0 in 0.424s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:39 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f Sep 03 12:11:39 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:39 devstack sudo[106856]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a" returned: 0 in 0.334s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:39 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a is being set with open permissions: ugo+rw Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:39 devstack sudo[106865]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a Sep 03 12:11:39 devstack sudo[106865]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:39 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-fe59ff14-877d-453a-a59b-78005777138f" returned: 0 in 0.290s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Lock "cinder-quobyte-fe59ff14-877d-453a-a59b-78005777138f" released by "delete_volume" :: held 0.807s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Created reservations ['f2cb8024-31bf-486b-9e5a-7423f795e09a', 'b290cd79-def9-4644-8209-21c45ee2315d', '11e33d3c-f973-49f5-863f-fa44384752fd', 'f04ec671-cc76-4ece-80a4-c97c5cce5c6c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:39 devstack sudo[106865]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a" returned: 0 in 0.282s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:39 devstack sudo[106869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:39 devstack sudo[106869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:39 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.info Sep 03 12:11:39 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:39 devstack sudo[106869]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.299s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:39 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Deleted volume successfully. Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-caa3eeef-9b0b-4de0-806e-7243a3732f1a tempest-ProjectReaderTests-936188469 None] Lock "cinder-fe59ff14-877d-453a-a59b-78005777138f-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:39 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.info" returned: 0 in 0.342s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:39 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.info is being set with open permissions: ugo+rw Sep 03 12:11:39 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:39 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.info Sep 03 12:11:39 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:40 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.info" returned: 0 in 0.280s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:40 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.276s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:40 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f4ee0b22-d8a7-4ccb-bfee-230bc96d4476 tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-f4642412-0969-48db-951e-3abe68798a4a-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Lock "cinder-f4642412-0969-48db-951e-3abe68798a4a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-07703115-acb3-4da7-8a88-6ef7b5aaaad2" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-07703115-acb3-4da7-8a88-6ef7b5aaaad2" acquired by "delete_snapshot" :: waited 0.026s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-f4642412-0969-48db-951e-3abe68798a4a" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-f4642412-0969-48db-951e-3abe68798a4a" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Deleting offline snapshot f4642412-0969-48db-951e-3abe68798a4a of volume 07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a583573-2af4-42aa-88d1-ecffae4b87d4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:41 devstack sudo[106885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a Sep 03 12:11:41 devstack sudo[106885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:41 devstack sudo[106885]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a" returned: 0 in 0.417s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[5263926e-4194-49e8-82a4-a6bb8e1f8f57]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:41 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:41 devstack sudo[106891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 Sep 03 12:11:41 devstack sudo[106891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:42 devstack sudo[106891]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2" returned: 0 in 0.398s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:42 devstack sudo[106896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a Sep 03 12:11:42 devstack sudo[106896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:42 devstack sudo[106896]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a" returned: 0 in 0.420s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:42 devstack sudo[106902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a Sep 03 12:11:42 devstack sudo[106902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:42 devstack sudo[106902]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2.f4642412-0969-48db-951e-3abe68798a4a" returned: 0 in 0.247s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-f4642412-0969-48db-951e-3abe68798a4a" released by "_delete_snapshot" :: held 1.620s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-07703115-acb3-4da7-8a88-6ef7b5aaaad2" released by "delete_snapshot" :: held 1.660s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:42 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Created reservations ['4141c724-c462-46f5-87a4-35c018d98cd4', '00c4131e-614c-4fe1-8422-dd0408185835', '784759b5-fa17-4efc-b4c3-e64ef3af7bdd', '2588339c-01d6-476c-95e4-ea5747349952'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:43 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-f943a989-63d5-4c65-949d-b936ed4a9e6c tempest-ProjectMemberTests-990816 None] Lock "cinder-f4642412-0969-48db-951e-3abe68798a4a-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-07703115-acb3-4da7-8a88-6ef7b5aaaad2-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Lock "cinder-07703115-acb3-4da7-8a88-6ef7b5aaaad2-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-07703115-acb3-4da7-8a88-6ef7b5aaaad2" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-07703115-acb3-4da7-8a88-6ef7b5aaaad2" acquired by "delete_volume" :: waited 0.028s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[607bb505-c540-4595-a7aa-b07748147238]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:43 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 Sep 03 12:11:43 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:43 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2" returned: 0 in 0.380s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:43 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:43 devstack sudo[106910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2 Sep 03 12:11:43 devstack sudo[106910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:44 devstack sudo[106910]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-07703115-acb3-4da7-8a88-6ef7b5aaaad2" returned: 0 in 0.281s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-07703115-acb3-4da7-8a88-6ef7b5aaaad2" released by "delete_volume" :: held 0.750s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Created reservations ['b97f1720-3277-430b-96e4-c47aaf63ed97', '25b045c1-99d3-4e22-ad4c-760166009fba', '0d4c765c-63ea-4d42-8f44-6f2efad26cd6', '3f8d3940-a85b-4b28-99e4-aa6643a7c202'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:44 devstack sudo[106915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:44 devstack sudo[106915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:44 devstack sudo[106915]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.297s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:44 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:11:44 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b5c316f0-3454-4141-9cfb-a1d549ff5224 tempest-ProjectMemberTests-990816 None] Lock "cinder-07703115-acb3-4da7-8a88-6ef7b5aaaad2-delete_volume" released by "delete_volume" :: held 1.393s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (689d7490-5447-4dd2-a3e6-e2732793734f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87009432-5b93-4293-89a8-03ccebb50af2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (87009432-5b93-4293-89a8-03ccebb50af2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674789436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c63868-f0f5-4976-8fcb-a875f086a16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:45Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f0a332-7899-45e4-8a21-41eeda635ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88f0a332-7899-45e4-8a21-41eeda635ddd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ed8d13-c3d5-45ea-a75b-21d29d78e025) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (40ed8d13-c3d5-45ea-a75b-21d29d78e025) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c63868-f0f5-4976-8fcb-a875f086a16a', 'volume_name': 'volume-d0c63868-f0f5-4976-8fcb-a875f086a16a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c564cb-943f-42db-830c-8e91b78a455e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2c564cb-943f-42db-830c-8e91b78a455e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4bd333-bb76-4e5a-bb61-379d86693db3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:45 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Volume d0c63868-f0f5-4976-8fcb-a875f086a16a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c63868-f0f5-4976-8fcb-a875f086a16a', 'volume_size': 1} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1674789436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c63868-f0f5-4976-8fcb-a875f086a16a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:45Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Creating volume d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:45 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:45 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:45 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a 1073741824 Sep 03 12:11:45 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:46 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a 1073741824" returned: 0 in 0.465s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:46 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a Sep 03 12:11:46 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:46 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a" returned: 0 in 0.269s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] <== create_volume: return (786ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.790s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab4bd333-bb76-4e5a-bb61-379d86693db3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c63868-f0f5-4976-8fcb-a875f086a16a', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ba148a-68a9-4bb1-8f7a-7af9eef22387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:46 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Volume volume-d0c63868-f0f5-4976-8fcb-a875f086a16a (d0c63868-f0f5-4976-8fcb-a875f086a16a): created successfully Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05ba148a-68a9-4bb1-8f7a-7af9eef22387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:46 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (689d7490-5447-4dd2-a3e6-e2732793734f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:46 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-9ad1aaf1-0d56-436b-be39-2ef16ddf22fa tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:11:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:47 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Creating offline snapshot 36aa408b-605f-4227-b556-cb32892efe7c of volume d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:47 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c82ede6-f37c-4333-894a-c0ba6a7dbae3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:47 devstack sudo[106928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a Sep 03 12:11:47 devstack sudo[106928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:47 devstack sudo[106928]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a" returned: 0 in 0.361s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:47 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:47 devstack sudo[106933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c 1G Sep 03 12:11:47 devstack sudo[106933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:48 devstack sudo[106933]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c 1G" returned: 0 in 0.398s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c63868-f0f5-4976-8fcb-a875f086a16a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:48 devstack sudo[106939]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c63868-f0f5-4976-8fcb-a875f086a16a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c Sep 03 12:11:48 devstack sudo[106939]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:48 devstack sudo[106939]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d0c63868-f0f5-4976-8fcb-a875f086a16a -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c" returned: 0 in 0.296s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:48 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c is being set with open permissions: ugo+rw Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:48 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c Sep 03 12:11:48 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:48 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=208,cinder:SELECT=177,cinder:INSERT=61,cinder:DELETE=20 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=175,cinder:INSERT=62,cinder:UPDATE=250,cinder:DELETE=18 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:11:48 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:48 devstack sudo[106947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.info Sep 03 12:11:48 devstack sudo[106947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:49 devstack sudo[106947]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.info" returned: 0 in 0.271s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:49 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.info is being set with open permissions: ugo+rw Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:49 devstack sudo[106950]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.info Sep 03 12:11:49 devstack sudo[106950]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:49 devstack sudo[106950]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.info" returned: 0 in 0.274s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.934s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:49 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-92c9ba58-9726-49ba-b071-e0e0c31e0590 tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-36aa408b-605f-4227-b556-cb32892efe7c-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Lock "cinder-36aa408b-605f-4227-b556-cb32892efe7c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.029s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-d0c63868-f0f5-4976-8fcb-a875f086a16a" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-d0c63868-f0f5-4976-8fcb-a875f086a16a" acquired by "delete_snapshot" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-36aa408b-605f-4227-b556-cb32892efe7c" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-36aa408b-605f-4227-b556-cb32892efe7c" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Deleting offline snapshot 36aa408b-605f-4227-b556-cb32892efe7c of volume d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[57446978-09ff-41e6-bd79-80e2261e1355]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:49 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:49 devstack sudo[106953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c Sep 03 12:11:49 devstack sudo[106953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:50 devstack sudo[106953]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c" returned: 0 in 0.386s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d0c63868-f0f5-4976-8fcb-a875f086a16a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7fc69d3-1467-4576-9018-16a9e1f3d5a3]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:50 devstack sudo[106958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a Sep 03 12:11:50 devstack sudo[106958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:50 devstack sudo[106958]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a" returned: 0 in 0.384s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:50 devstack sudo[106963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c Sep 03 12:11:50 devstack sudo[106963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:50 devstack sudo[106963]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c" returned: 0 in 0.367s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:50 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:51 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c Sep 03 12:11:51 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:51 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a.36aa408b-605f-4227-b556-cb32892efe7c" returned: 0 in 0.255s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-36aa408b-605f-4227-b556-cb32892efe7c" released by "_delete_snapshot" :: held 1.491s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-d0c63868-f0f5-4976-8fcb-a875f086a16a" released by "delete_snapshot" :: held 1.531s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Created reservations ['7b5b2756-764b-4d65-ad04-a47dde2d09b3', '436f08cc-1f9e-49ab-91a5-b1888263cd9b', 'bdda7f99-22f8-42b2-baec-c1b19fe3cc6f', 'd08fd2a8-8848-4453-baf5-ed297816a7c3'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:51 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-df2837dc-6298-4cad-8784-8d1a23116b2f tempest-ProjectMemberTests-990816 None] Lock "cinder-36aa408b-605f-4227-b556-cb32892efe7c-delete_snapshot" released by "delete_snapshot" :: held 1.712s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-d0c63868-f0f5-4976-8fcb-a875f086a16a-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Lock "cinder-d0c63868-f0f5-4976-8fcb-a875f086a16a-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-d0c63868-f0f5-4976-8fcb-a875f086a16a" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:51 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-d0c63868-f0f5-4976-8fcb-a875f086a16a" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ec76303-e017-4711-966c-df38c8f9d96c]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:52 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a Sep 03 12:11:52 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:52 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a" returned: 0 in 0.365s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:52 devstack sudo[106982]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a Sep 03 12:11:52 devstack sudo[106982]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:52 devstack sudo[106982]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-d0c63868-f0f5-4976-8fcb-a875f086a16a" returned: 0 in 0.237s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-d0c63868-f0f5-4976-8fcb-a875f086a16a" released by "delete_volume" :: held 0.671s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Created reservations ['ef8f2c45-c467-4749-8cbd-471c584261cf', '06b5eb89-ed2e-4614-bc04-ea0d23f602e3', 'f7f46287-b453-4c40-9601-3e88a85bca31', '3a371384-ef00-4a9d-b07f-43ecac7d55c3'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:52 devstack sudo[106985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:11:52 devstack sudo[106985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:52 devstack sudo[106985]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:52 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:11:52 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2f0de309-30ec-4128-b145-8458b85fd9e0 tempest-ProjectMemberTests-990816 None] Lock "cinder-d0c63868-f0f5-4976-8fcb-a875f086a16a-delete_volume" released by "delete_volume" :: held 1.133s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (0018db92-0ec2-48e3-8502-3cb3323d9cd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1383f0-2689-4c4a-b022-db7c2f1ee78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6a1383f0-2689-4c4a-b022-db7c2f1ee78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324532239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:54Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89199891-8ca0-4785-8737-c8a760027293) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (89199891-8ca0-4785-8737-c8a760027293) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba91e26-86c1-45d6-977b-f7c64c5164b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2ba91e26-86c1-45d6-977b-f7c64c5164b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d', 'volume_name': 'volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb10ad8-2d9f-4521-b6da-19f4a3acb9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebb10ad8-2d9f-4521-b6da-19f4a3acb9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16987462-89bb-45f2-87de-d78686fa2723) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:53 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Volume 24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d', 'volume_size': 1} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:11:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-324532239',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:11:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:11:54Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Creating volume 24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:11:53 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:11:53 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:53 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d 1073741824 Sep 03 12:11:53 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:54 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d 1073741824" returned: 0 in 0.455s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:54 devstack sudo[106995]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d Sep 03 12:11:54 devstack sudo[106995]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:54 devstack sudo[106995]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" returned: 0 in 0.251s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.756s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (16987462-89bb-45f2-87de-d78686fa2723) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bf0cf6-6b6f-407c-a3d2-df66de55c5d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:11:54 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Volume volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d (24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d): created successfully Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f2bf0cf6-6b6f-407c-a3d2-df66de55c5d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:11:54 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (0018db92-0ec2-48e3-8502-3cb3323d9cd5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:11:54 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-8a6121fc-4b99-436c-aa92-bddfeae300e8 tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:11:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:11:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:11:55 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Creating offline snapshot 31bc83ca-2320-4e0a-b63a-098b2d8b572d of volume 24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:11:55 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e863bc62-3698-4462-aade-85c1fe2208fd]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:55 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:55 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d Sep 03 12:11:55 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:56 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" returned: 0 in 0.359s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:56 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d 1G Sep 03 12:11:56 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:56 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d 1G" returned: 0 in 0.431s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:56 devstack sudo[107010]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d Sep 03 12:11:56 devstack sudo[107010]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:56 devstack sudo[107010]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d" returned: 0 in 0.307s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:56 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d is being set with open permissions: ugo+rw Sep 03 12:11:56 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:56 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d Sep 03 12:11:56 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:57 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d" returned: 0 in 0.263s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:57 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.info Sep 03 12:11:57 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:57 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.info" returned: 0 in 0.267s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:57 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.info is being set with open permissions: ugo+rw Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:57 devstack sudo[107021]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.info Sep 03 12:11:57 devstack sudo[107021]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:57 devstack sudo[107021]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.info" returned: 0 in 0.239s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.947s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:11:57 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5b4752e7-f0f7-4d09-80dc-5da0e7fff91b tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-31bc83ca-2320-4e0a-b63a-098b2d8b572d-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Lock "cinder-31bc83ca-2320-4e0a-b63a-098b2d8b572d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-31bc83ca-2320-4e0a-b63a-098b2d8b572d" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-31bc83ca-2320-4e0a-b63a-098b2d8b572d" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Deleting offline snapshot 31bc83ca-2320-4e0a-b63a-098b2d8b572d of volume 24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:11:57 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1fa6b2ec-81eb-4741-b581-694e8f37fa39]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:58 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d Sep 03 12:11:58 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:58 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d" returned: 0 in 0.361s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aeb9cf8-1c09-43d2-aefd-5a15900a3f12]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:58 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d Sep 03 12:11:58 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:58 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" returned: 0 in 0.344s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:58 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:58 devstack sudo[107034]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d Sep 03 12:11:58 devstack sudo[107034]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:59 devstack sudo[107034]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d" returned: 0 in 0.326s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:11:59 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d Sep 03 12:11:59 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:11:59 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Sep 03 12:11:59 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d.31bc83ca-2320-4e0a-b63a-098b2d8b572d" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:11:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-31bc83ca-2320-4e0a-b63a-098b2d8b572d" released by "_delete_snapshot" :: held 1.372s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" released by "delete_snapshot" :: held 1.393s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:11:59 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Created reservations ['da5c3803-033b-42b8-a438-5f81c8c20ede', 'c7ab307f-83ee-4353-acf3-2950e88a7013', 'ea05d2bc-cac4-472b-95b2-b9c68cde4d57', '4b29cbab-46a3-40bb-a657-3ee1e96accd6'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:11:59 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:11:59 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-7c5fec36-1d41-4c11-9eed-e3fada2b52bd tempest-ProjectMemberTests-990816 None] Lock "cinder-31bc83ca-2320-4e0a-b63a-098b2d8b572d-delete_snapshot" released by "delete_snapshot" :: held 1.518s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Lock "cinder-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e963618f-1f19-42ee-9f0d-fc0c0b947d73]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:00 devstack sudo[107043]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d Sep 03 12:12:00 devstack sudo[107043]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:00 devstack sudo[107043]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" returned: 0 in 0.349s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:00 devstack sudo[107048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d Sep 03 12:12:00 devstack sudo[107048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:00 devstack sudo[107048]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" returned: 0 in 0.248s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d" released by "delete_volume" :: held 0.647s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Created reservations ['739a7da8-44b5-4abb-ac45-28496081dafe', 'a04f030b-ba95-4059-a2cf-cb342fe9374f', '7cdba071-5070-4580-a675-f787ee10ceba', '781ac986-4b4b-4803-a39f-be140625d37c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:00 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:00 devstack sudo[107051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:12:00 devstack sudo[107051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:01 devstack sudo[107051]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.246s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:12:01 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-6e9fe695-d560-45e3-9227-66cb387266d2 tempest-ProjectMemberTests-990816 None] Lock "cinder-24f8ddc8-3ca8-40c5-a1dd-b07c2b33f88d-delete_volume" released by "delete_volume" :: held 1.085s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (bb63948f-c357-4b20-9681-ff32a2554d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a00d868-9948-4cb3-b859-6bedaa5606be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9a00d868-9948-4cb3-b859-6bedaa5606be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107904072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f5c55-2654-4950-ab1b-92fe990ec771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:12:02Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206778e-fe97-461e-9a19-52bd1d050432) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2206778e-fe97-461e-9a19-52bd1d050432) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a975b2-12c0-4a72-9243-7be3d2af62a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a975b2-12c0-4a72-9243-7be3d2af62a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '760f5c55-2654-4950-ab1b-92fe990ec771', 'volume_name': 'volume-760f5c55-2654-4950-ab1b-92fe990ec771', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd5efdd-1c4c-4109-b057-e9be9d94c3d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5bd5efdd-1c4c-4109-b057-e9be9d94c3d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29670a95-b269-4211-9a89-63f1e7552639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:01 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Volume 760f5c55-2654-4950-ab1b-92fe990ec771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-760f5c55-2654-4950-ab1b-92fe990ec771', 'volume_size': 1} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:12:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1107904072',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=760f5c55-2654-4950-ab1b-92fe990ec771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:12:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:12:02Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Creating volume 760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:12:01 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:12:01 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:01 devstack sudo[107054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 1073741824 Sep 03 12:12:01 devstack sudo[107054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:02 devstack sudo[107054]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 1073741824" returned: 0 in 0.395s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:02 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 Sep 03 12:12:02 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:02 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771" returned: 0 in 0.238s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] <== create_volume: return (674ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.676s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (29670a95-b269-4211-9a89-63f1e7552639) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-760f5c55-2654-4950-ab1b-92fe990ec771', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cea3069-ca9a-49b4-be9e-eb8a13c2707e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:02 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Volume volume-760f5c55-2654-4950-ab1b-92fe990ec771 (760f5c55-2654-4950-ab1b-92fe990ec771): created successfully Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5cea3069-ca9a-49b4-be9e-eb8a13c2707e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (bb63948f-c357-4b20-9681-ff32a2554d3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:12:02 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-c441bdd9-4333-4992-aeca-44167df45e43 tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Creating offline snapshot 8b336e84-8eb7-4ba4-a3fd-098f4952bf40 of volume 760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1306c1b-018b-4297-a486-9aee4c0c2b7e]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:02 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:02 devstack sudo[107063]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 Sep 03 12:12:02 devstack sudo[107063]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:03 devstack sudo[107063]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771" returned: 0 in 0.356s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:03 devstack sudo[107069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 1G Sep 03 12:12:03 devstack sudo[107069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:03 devstack sudo[107069]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 1G" returned: 0 in 0.381s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760f5c55-2654-4950-ab1b-92fe990ec771 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:03 devstack sudo[107074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760f5c55-2654-4950-ab1b-92fe990ec771 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 Sep 03 12:12:03 devstack sudo[107074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:03 devstack sudo[107074]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-760f5c55-2654-4950-ab1b-92fe990ec771 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40" returned: 0 in 0.289s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:03 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 is being set with open permissions: ugo+rw Sep 03 12:12:03 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:03 devstack sudo[107079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 Sep 03 12:12:03 devstack sudo[107079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:04 devstack sudo[107079]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:04 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.info Sep 03 12:12:04 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:04 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.info" returned: 0 in 0.268s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:04 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.info is being set with open permissions: ugo+rw Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:04 devstack sudo[107086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.info Sep 03 12:12:04 devstack sudo[107086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:04 devstack sudo[107086]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.info" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.873s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:04 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-202ed91c-a8fd-45d4-9571-6cb1feaf74ec tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-8b336e84-8eb7-4ba4-a3fd-098f4952bf40-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Lock "cinder-8b336e84-8eb7-4ba4-a3fd-098f4952bf40-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-760f5c55-2654-4950-ab1b-92fe990ec771" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-760f5c55-2654-4950-ab1b-92fe990ec771" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-8b336e84-8eb7-4ba4-a3fd-098f4952bf40" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:04 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-8b336e84-8eb7-4ba4-a3fd-098f4952bf40" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Deleting offline snapshot 8b336e84-8eb7-4ba4-a3fd-098f4952bf40 of volume 760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[bbeddf8c-e481-481a-8980-ad5a939498c5]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:05 devstack sudo[107089]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 Sep 03 12:12:05 devstack sudo[107089]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:05 devstack sudo[107089]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40" returned: 0 in 0.353s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-760f5c55-2654-4950-ab1b-92fe990ec771(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[43fb40cc-8f4e-473c-b771-1aa13805689a]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:05 devstack sudo[107095]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 Sep 03 12:12:05 devstack sudo[107095]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:05 devstack sudo[107095]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771" returned: 0 in 0.345s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:05 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:05 devstack sudo[107100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 Sep 03 12:12:05 devstack sudo[107100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:06 devstack sudo[107100]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40" returned: 0 in 0.332s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:06 devstack sudo[107106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40 Sep 03 12:12:06 devstack sudo[107106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:06 devstack sudo[107106]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:06 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771.8b336e84-8eb7-4ba4-a3fd-098f4952bf40" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-8b336e84-8eb7-4ba4-a3fd-098f4952bf40" released by "_delete_snapshot" :: held 1.364s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-760f5c55-2654-4950-ab1b-92fe990ec771" released by "delete_snapshot" :: held 1.384s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:06 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Created reservations ['45b5bb9b-edb5-41fb-b621-88adbdac7f6b', 'dee43c4f-fe74-4ff7-a4ae-c62a3a764ccc', '4f4e567a-2279-45e0-9e84-c42901a4e9df', '36c4ca70-83a9-43ce-b58f-36ef93022a9f'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:12:06 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:12:06 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-fc204684-7c77-4034-b6e6-c8b51ff4aa9f tempest-ProjectMemberTests-990816 None] Lock "cinder-8b336e84-8eb7-4ba4-a3fd-098f4952bf40-delete_snapshot" released by "delete_snapshot" :: held 1.506s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-760f5c55-2654-4950-ab1b-92fe990ec771-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Lock "cinder-760f5c55-2654-4950-ab1b-92fe990ec771-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-760f5c55-2654-4950-ab1b-92fe990ec771" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-760f5c55-2654-4950-ab1b-92fe990ec771" acquired by "delete_volume" :: waited 0.016s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[e42c4d43-3082-4940-aec2-49b6e9621390]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:07 devstack sudo[107109]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 Sep 03 12:12:07 devstack sudo[107109]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:07 devstack sudo[107109]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771" returned: 0 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:07 devstack sudo[107114]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771 Sep 03 12:12:07 devstack sudo[107114]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:07 devstack sudo[107114]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-760f5c55-2654-4950-ab1b-92fe990ec771" returned: 0 in 0.248s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-760f5c55-2654-4950-ab1b-92fe990ec771" released by "delete_volume" :: held 0.648s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Created reservations ['44208766-63c7-4f46-a222-c70a1371f535', '4dd1fd34-98f6-476a-9322-b4fd675eaece', '8c8be4f4-1a78-4b86-9714-581f7d2cacaf', 'b785b866-c44d-4858-8ff2-7b2bd4b6d2a3'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:07 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:07 devstack sudo[107117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:12:07 devstack sudo[107117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:08 devstack sudo[107117]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.251s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:12:08 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-18d4459f-639b-472a-8cd3-f933190a5aea tempest-ProjectMemberTests-990816 None] Lock "cinder-760f5c55-2654-4950-ab1b-92fe990ec771-delete_volume" released by "delete_volume" :: held 1.101s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (f06c3b9e-95d5-42f4-8bb8-74e367316bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6e030c-e60c-4380-a5b4-9e187c082958) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e6e030c-e60c-4380-a5b4-9e187c082958) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301893400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf191b0-b738-4266-876b-2f1533ea4bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:12:09Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08eb096-90a0-44d4-b2e6-c938dd2e7abc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b08eb096-90a0-44d4-b2e6-c938dd2e7abc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275fa112-fe95-4b98-879d-ef8bc9cbf8c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (275fa112-fe95-4b98-879d-ef8bc9cbf8c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'daf191b0-b738-4266-876b-2f1533ea4bbe', 'volume_name': 'volume-daf191b0-b738-4266-876b-2f1533ea4bbe', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f4d934-66c6-43c1-af16-5289e1d99336) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e0f4d934-66c6-43c1-af16-5289e1d99336) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0661c14c-21cf-4b37-96ff-907707d1fc06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:08 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Volume daf191b0-b738-4266-876b-2f1533ea4bbe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-daf191b0-b738-4266-876b-2f1533ea4bbe', 'volume_size': 1} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:12:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-301893400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=daf191b0-b738-4266-876b-2f1533ea4bbe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:12:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:12:09Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Creating volume daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:12:08 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:12:08 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:08 devstack sudo[107120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe 1073741824 Sep 03 12:12:08 devstack sudo[107120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:09 devstack sudo[107120]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe 1073741824" returned: 0 in 0.426s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:09 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe Sep 03 12:12:09 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:09 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] <== create_volume: return (714ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.717s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0661c14c-21cf-4b37-96ff-907707d1fc06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-daf191b0-b738-4266-876b-2f1533ea4bbe', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6630c8f4-1d97-4f85-96ac-0f5fde60168d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:09 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Volume volume-daf191b0-b738-4266-876b-2f1533ea4bbe (daf191b0-b738-4266-876b-2f1533ea4bbe): created successfully Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6630c8f4-1d97-4f85-96ac-0f5fde60168d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (f06c3b9e-95d5-42f4-8bb8-74e367316bfa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:12:09 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-fd5800fe-b3bf-4999-9d6f-a5ce6e7acee9 tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Creating offline snapshot ab581288-9407-43b8-8bdf-388c6296fc14 of volume daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[2aa9d4dd-5423-411f-8076-6c26026ea675]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:09 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:10 devstack sudo[107129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe Sep 03 12:12:10 devstack sudo[107129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:10 devstack sudo[107129]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe" returned: 0 in 0.365s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:10 devstack sudo[107134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 1G Sep 03 12:12:10 devstack sudo[107134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:10 devstack sudo[107134]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 1G" returned: 0 in 0.383s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf191b0-b738-4266-876b-2f1533ea4bbe -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:10 devstack sudo[107139]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf191b0-b738-4266-876b-2f1533ea4bbe -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 Sep 03 12:12:10 devstack sudo[107139]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:10 devstack sudo[107139]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-daf191b0-b738-4266-876b-2f1533ea4bbe -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14" returned: 0 in 0.290s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:10 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 is being set with open permissions: ugo+rw Sep 03 12:12:10 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:10 devstack sudo[107144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 Sep 03 12:12:10 devstack sudo[107144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:11 devstack sudo[107144]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14" returned: 0 in 0.255s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:11 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.info Sep 03 12:12:11 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:11 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.info" returned: 0 in 0.250s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:11 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.info is being set with open permissions: ugo+rw Sep 03 12:12:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:11 devstack sudo[107150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.info Sep 03 12:12:11 devstack sudo[107150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:11 devstack sudo[107150]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.info" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:11 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.882s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:11 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-5caf2f5a-31de-47d0-b260-7aff1f4149b4 tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-ab581288-9407-43b8-8bdf-388c6296fc14-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Lock "cinder-ab581288-9407-43b8-8bdf-388c6296fc14-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-daf191b0-b738-4266-876b-2f1533ea4bbe" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-daf191b0-b738-4266-876b-2f1533ea4bbe" acquired by "delete_snapshot" :: waited 0.014s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-ab581288-9407-43b8-8bdf-388c6296fc14" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-ab581288-9407-43b8-8bdf-388c6296fc14" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Deleting offline snapshot ab581288-9407-43b8-8bdf-388c6296fc14 of volume daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[c32163a7-d695-4205-b7e1-46790a673d39]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:12 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 Sep 03 12:12:12 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:12 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14" returned: 0 in 0.356s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-daf191b0-b738-4266-876b-2f1533ea4bbe(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[af2a24f8-0530-4c92-8528-0b91573b86de]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:12 devstack sudo[107158]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe Sep 03 12:12:12 devstack sudo[107158]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:12 devstack sudo[107158]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe" returned: 0 in 0.343s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:12 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:12 devstack sudo[107163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 Sep 03 12:12:12 devstack sudo[107163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:13 devstack sudo[107163]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14" returned: 0 in 0.332s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:13 devstack sudo[107168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14 Sep 03 12:12:13 devstack sudo[107168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:13 devstack sudo[107168]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:13 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe.ab581288-9407-43b8-8bdf-388c6296fc14" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-ab581288-9407-43b8-8bdf-388c6296fc14" released by "_delete_snapshot" :: held 1.359s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-daf191b0-b738-4266-876b-2f1533ea4bbe" released by "delete_snapshot" :: held 1.378s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:13 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Created reservations ['1853e4c7-7b84-427f-9cae-14e3d88f92f9', '8cc835dd-2211-494a-aef4-4940144635c0', '78447fb4-3217-4482-940c-0c32f925598c', '6b123b8c-5393-43d3-8c60-0cc2d26ef36c'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:12:13 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:12:13 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-1ce5d08d-88bf-44d2-84af-75b0a879d3df tempest-ProjectMemberTests-990816 None] Lock "cinder-ab581288-9407-43b8-8bdf-388c6296fc14-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-daf191b0-b738-4266-876b-2f1533ea4bbe-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Lock "cinder-daf191b0-b738-4266-876b-2f1533ea4bbe-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-daf191b0-b738-4266-876b-2f1533ea4bbe" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-daf191b0-b738-4266-876b-2f1533ea4bbe" acquired by "delete_volume" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f333f10-64a0-4368-baa6-b3e34acea9c4]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:14 devstack sudo[107172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe Sep 03 12:12:14 devstack sudo[107172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:14 devstack sudo[107172]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe" returned: 0 in 0.348s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:14 devstack sudo[107177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe Sep 03 12:12:14 devstack sudo[107177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:14 devstack sudo[107177]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-daf191b0-b738-4266-876b-2f1533ea4bbe" returned: 0 in 0.245s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-daf191b0-b738-4266-876b-2f1533ea4bbe" released by "delete_volume" :: held 0.646s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Created reservations ['04aabdbb-360b-417d-b3b2-b5ef1a515cc5', '1085dbdd-a57d-4846-81a8-2fbcf26ea0af', 'b4a0803d-f634-4925-9e8a-dfb60e7f260e', 'efbe96aa-7231-4774-959d-f7c5b1bc43bc'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:14 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:15 devstack sudo[107180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:12:15 devstack sudo[107180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:15 devstack sudo[107180]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.264s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:12:15 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-ad885be2-5c53-479c-af32-f576fef502af tempest-ProjectMemberTests-990816 None] Lock "cinder-daf191b0-b738-4266-876b-2f1533ea4bbe-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.flows.manager.create_volume [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=87256) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (05630898-9a0b-4300-b3cf-9b2c09a10630) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715f9790-b6ec-4e20-916c-3bc34aaf95b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (715f9790-b6ec-4e20-916c-3bc34aaf95b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2473977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a448df6e-e45e-4249-9722-b78224ddf6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:12:16Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b377b-c7fc-4b5d-990c-bffeb0ded273) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (504b377b-c7fc-4b5d-990c-bffeb0ded273) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa906bef-9a32-40c7-a562-d5753cd284e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa906bef-9a32-40c7-a562-d5753cd284e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a448df6e-e45e-4249-9722-b78224ddf6d0', 'volume_name': 'volume-a448df6e-e45e-4249-9722-b78224ddf6d0', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae3dfae-67e7-41de-bf02-7b097db5704a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ae3dfae-67e7-41de-bf02-7b097db5704a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c005105-b86c-4a2f-b2f4-1375e7ae000d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:15 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Volume a448df6e-e45e-4249-9722-b78224ddf6d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a448df6e-e45e-4249-9722-b78224ddf6d0', 'volume_size': 1} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-09-03T10:12:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2473977',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a448df6e-e45e-4249-9722-b78224ddf6d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3cedfb9ce1944e6a24f14cdc430015c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-09-03T10:12:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-09-03T10:12:16Z,use_quota=True,user_id='c170aa669c234663941c14c1ca42fe49',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0d3119e5-577a-493e-8ddc-1cfe11061c3e),volume_type_id=0d3119e5-577a-493e-8ddc-1cfe11061c3e)}" {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1497}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Creating volume a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Selected osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 as target Quobyte volume. {{(pid=87256) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Sep 03 12:12:15 devstack cinder-volume[87256]: INFO cinder.volume.drivers.remotefs [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] casted to osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885 Sep 03 12:12:15 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 1073741824 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:15 devstack sudo[107183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 1073741824 Sep 03 12:12:15 devstack sudo[107183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:16 devstack sudo[107183]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 1073741824" returned: 0 in 0.402s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:16 devstack sudo[107188]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 Sep 03 12:12:16 devstack sudo[107188]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:16 devstack sudo[107190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:12:16 devstack sudo[107190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:16 devstack sudo[107188]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0" returned: 0 in 0.251s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] <== create_volume: return (695ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'} {{(pid=87256) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1522}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5c005105-b86c-4a2f-b2f4-1375e7ae000d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a448df6e-e45e-4249-9722-b78224ddf6d0', 'volume_size': 1}' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:16 devstack sudo[107190]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02fce86-7d62-4eb8-93c3-3b7ff78511c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.261s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_service.periodic_task [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] Running periodic task VolumeManager._thread_info {{(pid=87256) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread count: 29 {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-8d5b7e18-9d63-473a-9e03-3cc754537d0b None None] thread info: [<_MainThread(MainThread, started 126993206870144)>, , , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=87256) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Sep 03 12:12:16 devstack cinder-volume[87256]: INFO cinder.volume.flows.manager.create_volume [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Volume volume-a448df6e-e45e-4249-9722-b78224ddf6d0 (a448df6e-e45e-4249-9722-b78224ddf6d0): created successfully Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a02fce86-7d62-4eb8-93c3-3b7ff78511c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=87256) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Flow 'volume_create_manager' (05630898-9a0b-4300-b3cf-9b2c09a10630) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=87256) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Sep 03 12:12:16 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-581463dc-0786-4148-8b13-94be560389d7 tempest-ProjectMemberTests-990816 None] Created volume successfully. Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Creating offline snapshot 89f4f282-98e9-4157-bd80-6deef0164a49 of volume a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[be089181-8e30-431f-ab26-e44b3fa75d08]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:16 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:17 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 Sep 03 12:12:17 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:17 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0" returned: 0 in 0.350s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 1G {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:17 devstack sudo[107199]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 1G Sep 03 12:12:17 devstack sudo[107199]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:17 devstack sudo[107199]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 1G" returned: 0 in 0.381s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a448df6e-e45e-4249-9722-b78224ddf6d0 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:17 devstack sudo[107204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a448df6e-e45e-4249-9722-b78224ddf6d0 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 Sep 03 12:12:17 devstack sudo[107204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:17 devstack sudo[107204]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-a448df6e-e45e-4249-9722-b78224ddf6d0 -F qcow2 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49" returned: 0 in 0.300s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:17 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 is being set with open permissions: ugo+rw Sep 03 12:12:17 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:17 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 Sep 03 12:12:17 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:18 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49" returned: 0 in 0.243s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:18 devstack sudo[107212]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.info Sep 03 12:12:18 devstack sudo[107212]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:18 devstack sudo[107212]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.info" returned: 0 in 0.249s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:18 devstack cinder-volume[87256]: WARNING cinder.volume.drivers.remotefs [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.info is being set with open permissions: ugo+rw Sep 03 12:12:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.info {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:18 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.info Sep 03 12:12:18 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:18 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.info" returned: 0 in 0.243s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:18 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:18 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-35011729-7f8a-4a1c-8ca2-7d5d374c1758 tempest-ProjectMemberTests-990816 None] Create snapshot completed successfully Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-89f4f282-98e9-4157-bd80-6deef0164a49-delete_snapshot" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Lock "cinder-89f4f282-98e9-4157-bd80-6deef0164a49-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-a448df6e-e45e-4249-9722-b78224ddf6d0" by "delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-a448df6e-e45e-4249-9722-b78224ddf6d0" acquired by "delete_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-89f4f282-98e9-4157-bd80-6deef0164a49" by "_delete_snapshot" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-89f4f282-98e9-4157-bd80-6deef0164a49" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Deleting offline snapshot 89f4f282-98e9-4157-bd80-6deef0164a49 of volume a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] snapshot_file for this snap is: volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 {{(pid=87256) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9b615c3-8796-498b-bf01-6472ed95060b]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:19 devstack sudo[107218]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 Sep 03 12:12:19 devstack sudo[107218]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:19 devstack sudo[107218]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49" returned: 0 in 0.347s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.remotefs [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a448df6e-e45e-4249-9722-b78224ddf6d0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=87256) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[228700e0-5a3a-44d8-97ec-0aaf058f80de]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:19 devstack sudo[107223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 Sep 03 12:12:19 devstack sudo[107223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:19 devstack sudo[107223]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0" returned: 0 in 0.352s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:19 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:19 devstack sudo[107228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 Sep 03 12:12:19 devstack sudo[107228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:20 devstack sudo[107228]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49" returned: 0 in 0.325s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:20 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49 Sep 03 12:12:20 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:20 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:20 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0.89f4f282-98e9-4157-bd80-6deef0164a49" returned: 0 in 0.240s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-89f4f282-98e9-4157-bd80-6deef0164a49" released by "_delete_snapshot" :: held 1.350s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-a448df6e-e45e-4249-9722-b78224ddf6d0" released by "delete_snapshot" :: held 1.373s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:20 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Created reservations ['17f7323a-b286-49f2-b17b-00802910a4cc', 'cfec4b59-9112-439f-856a-65f7b8624cf1', 'e4733825-e357-439c-b98e-5e5b6b0aacc8', 'f60a3483-20ac-4d1f-a460-ba03bfcea694'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:12:20 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Delete snapshot completed successfully. Sep 03 12:12:20 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-2cdda550-dc28-4b63-a00f-7cb43228bce1 tempest-ProjectMemberTests-990816 None] Lock "cinder-89f4f282-98e9-4157-bd80-6deef0164a49-delete_snapshot" released by "delete_snapshot" :: held 1.502s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-a448df6e-e45e-4249-9722-b78224ddf6d0-delete_volume" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Lock "cinder-a448df6e-e45e-4249-9722-b78224ddf6d0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Acquiring lock "cinder-quobyte-a448df6e-e45e-4249-9722-b78224ddf6d0" by "delete_volume" {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-a448df6e-e45e-4249-9722-b78224ddf6d0" acquired by "delete_volume" :: waited 0.021s {{(pid=87256) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dfafec2-9810-4470-b20a-d06f4ccece83]: (4, 'qcow2') {{(pid=88589) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:21 devstack sudo[107238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 Sep 03 12:12:21 devstack sudo[107238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:21 devstack sudo[107238]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0" returned: 0 in 0.353s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:21 devstack sudo[107243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0 Sep 03 12:12:21 devstack sudo[107243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:21 devstack sudo[107243]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665/volume-a448df6e-e45e-4249-9722-b78224ddf6d0" returned: 0 in 0.247s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:21 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Lock "cinder-quobyte-a448df6e-e45e-4249-9722-b78224ddf6d0" released by "delete_volume" :: held 0.655s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG cinder.quota [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Created reservations ['da71aa3e-40cf-48d6-8284-52a8cbf5d760', '1991888d-594a-4dfe-ab85-1970aea8099e', 'ec857357-0622-4c11-96d8-9ca6836e2287', '5c667949-6f29-4962-9a23-56c075257980'] {{(pid=87256) reserve /opt/stack/cinder/cinder/quota.py:752}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885': None} {{(pid=87256) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG cinder.volume.drivers.quobyte [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-74cfeada-e64d-410d-9921-183ef29a4885'] {{(pid=87256) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.lockutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=87256) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Sep 03 12:12:22 devstack sudo[107246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665 Sep 03 12:12:22 devstack sudo[107246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Sep 03 12:12:22 devstack sudo[107246]: pam_unix(sudo:session): session closed for user root Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG oslo_concurrency.processutils [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/5eb6cbf57feb9de60eb858d5b7964665" returned: 0 in 0.254s {{(pid=87256) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG cinder.manager [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Notifying Schedulers of capabilities ... {{(pid=87256) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Sep 03 12:12:22 devstack cinder-volume[87256]: INFO cinder.volume.manager [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Deleted volume successfully. Sep 03 12:12:22 devstack cinder-volume[87256]: DEBUG cinder.coordination [None req-b1546e61-9df1-4427-9081-d5087586fca1 tempest-ProjectMemberTests-990816 None] Lock "cinder-a448df6e-e45e-4249-9722-b78224ddf6d0-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=87256) __release /opt/stack/cinder/cinder/coordination.py:152}} Sep 03 12:12:40 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:UPDATE=86,cinder:SELECT=64,cinder:INSERT=26,cinder:DELETE=4 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Sep 03 12:12:40 devstack cinder-volume[87256]: DEBUG dbcounter [-] [87256] Writing DB stats cinder:SELECT=70,cinder:INSERT=23,cinder:DELETE=10,cinder:UPDATE=87 {{(pid=87256) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}